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.  FOREWORD 


The  Advisory  Group  ori  K«lliibliity  of  Elretronlc  Fqi^p.vht  w.«8  ettfbUAhod 
by  tho  Resenreh  and  Dcvelopiiwnt  T^rd  as  an  agfncy  of  ti»'CdBritt;«*H>n'Ele«^'nirf 
on  ?1  August  19r>2i  Its  .pur7>oa"e  vra  to  roiiitdr  and  .atijraia*^  int^^st  is  'wili  ’ 
bility  ™tt-«rs  and  rccomsnd  ronswrs  wlvlch  vdkld^reattit  .li  aoro  rellabla; 
•lacirohlc  equlpmnt<  •  -  .• 


Thi  Advlsiory  Group  vaa  continued  uhier  ibe  Assistant  ^ercta^.of ‘uirsne* 
(Keseorch  and  IJeVelopnent)  j  updn  the  alxiiltidn  of  tti#  ,H2S  'ih,lP53»<a^  It  iM 
re-pstabilshed  In  19;)!i  '.8s  an  agency  of'-tiie  Offica  of  the  Assistant  fecreUrC  of ' 
beferife  (Applications  Enciheerlne)-.  .The  pilose  and  w^rsiil'p  ro^n^'  ‘ 
wsentialiy  tho  sane  durl!ie.tiiese>adnlnlsi.rati.vp' change.-  , 


In  late  l9!5S*  it  appeared  tliat.siifflcietA  icijwiea^  ySs-a^llabie^ata 
Sufficldht  irterost  aroused  that  spirolfic.stepe  cpuld'he  tiVen  twaW  quahtif 
:fylng  'rellabiiity  j'equir«r  i  ariid  tevard  defel^ing'Suitabie^Usta  to  ««r>^ 
that  ouch  requirewnts  are  net.  Cofieeqi*ht^j-4'progra!a  df-Mi»  >aslc»  -in'-|^., 
areas,  of  nucvrical  reilabUity  roqulrotients'i  tests,  design. procedures^  conpenerTt#,' 
pr^uronent,.pacfc»clng  ard  trahsportatidn,  storage,  and;  ccaratiqh  anl  hainterahee-  ' 
.was  established,  A  ^8k  groun  of  pccpic  frpn-the  KilitiV^  IVoartnents-ahi 
IfiJusti^  HAS  asslgricd’vo  each  of  tfe  tasks  early  lb TJiese  tick  growls.  . 

nskfid  to  submit  their  findings  in  the  fpr«,df  a  repdrt  after  .they  lud  -  -  '  [ 
cbnsiilorod  all,  aspects  of  their  acslgncd  tsski.- ■  *  i 


Tliir  doc'ia?ht  Is  a  consolidation  6f  the  nl;,#  task  group  ropdrte'-and.is. 
issued  at  this  tine  br^y  for  inforrntiohal  purpaeesi  .-iftheds  .of, i^.-leaenllrg. 
ihe  rre  jraTorvIctlons  contained  in  this  rdpsrt  are  beiiig  studied  by  Pepsrtfeht' 
'of  'Mfense  agoncles.  '  ‘  .  '  '  , 


7)»  recipients  of  this  rocort  are  ur{;ed  to  utilice  aqy.  pf.tiiis’mtcrial 
that  may  Ic  useful  and  appropriate  to  tfisir  aetlaltles.' 


d.  m;  bridges 
Chairrah 

Adrisb-y  Group. oh  f^iiahiiity  of 
rlectroaie  Equipment 
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1.  Klf.lrua  Aeccpf«bility_  figures  ,.  i  i.  .,•• 
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•-  Eiectrbfilc  S^ulicent-  i  i  :  .  i  ;•  i  •;  .■■  ; 
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PROGRAM  FOR  AGREE 


1.  >Vvelop  san^..-  scceptaMiltjr  fi|:  a:*s  !ot  rcllabllltj  cf  U*  wlswi 
types  of  miUtsrr  iXeetwnis  equipnent.  These  firiares  cosslb)!/  t«y  he  expressed 
«  tiwk  ‘■:Ue»r.  rsliuref"  or  eone  other  truly  quentiUtiee  r»«ssr«»3t.  the 
bests  upon  which  the  figures  ere  actemlned  shall  ineluie  the  factors  of  oper- 
•ettorwl  ^«sion  requlreaents,  «sintenenee,  cocplexity,  end  such  ether  fectors  as 
my  be  significant, 

?.  hevelop  basic  requirements  for  test&  te  be  awccpllshed  cn  deseloawnt 
Models  which  will  prove  that  ti.e  design  is  capable  of  rmetlxm  the 
acceptability  figure  for  reliability  established  for  the  equljweBt  t.jw.  These 
tests  shall  be  designed  .to  be  •perforraed  either  in  addition. to,  or  Ir.  M&doaettoB 
Hithj  whatever  perforiianee  evaluations  are  specified  for  tte  eouiipi^st. 

■  3,  Beveiop  basic  reculVeaehts  for  tests  to  be.  aeeoiqJllsSr-d  on  jdlat-  • 
production  and  un  production  s»*els  which  will  nrove  conclusively. that  Wse 
equipwnt  will  nret  the  udAlnuA  acceptability  figure  for  .rellabilitr •established 
fj*!,*^*  equipnent  -type.  Piece  le.«-ts  slinll  I*  designed' to  be  perf creed  either  1ft 
eddition  to,  or  In  conjunction  with,  wlsatever'  cert'ormnee  ePiiuatlens  oser- 

atlonai  suitability  evaluations  are  specified  fw  the  equlp«nt,  . 

li,  Inveatiga.te  aqd  reconhend  nsthods  of  specifying  developaaat  prose-lures 
.to  Imure  tiiat  equipwnt  designs  wiU  have  the  inherent. rell#bUity  req-uired, 

-actors  wnicn  alght  be  involved  tret  (1)  theorttlCdl  reliability  predictlcB 
■  (?)  thorough  coiiponcnt  sriEctSon,  quaiificstion,  aaJ  applicstion  for  specific 
.ciwttit  an!  e.Tvlrciuncnt  requiresrnts,  (3)  adequate -signal  levels  and  feedback, 
aal  tuj  mirujulsing  the  effect#  of  nechanlcsl  shjck,  vibration  und  teaoerature 
on  critical  con^orients,  .  .  .  •  ' 

f.  Establish  criteria  and  .iiethcds  for  specifying  the  reliatllitr  of  ee«l' 
ponrnt  parta  anil  tulss  in  ter.no  cS  failure  rote  as-  a  function  of  tiv'a:^ 
environnvnt.  This  if  eenaiiered  esrential  to  a  detemiriation  of  the  aac^a^t  of’ 
amrovenenfjenandsd  in  vsrio-ii  co.-:po:»£  nts  to  wiet  the  over-all  reliability 
require.-vnts  of  the  various  tyf-es  of  electronic  equipaento,  ■ 


6.  j.tidy  present  prerun 
det»rcd.-.e  their  x:or?.att*-iiity 
for  specific  changes  ns  f 
ir.vclvei  -light  hc»  ())  a«fers 
^A.U'i.*.''ic,Hion  '•■f  Poltvy  Cevr- 
Tecf..-.'.c  .1  or  '’.j.-pcja . 
of  srieolion  ot  ccntra-Ujiu 
of  ini.4'iHi:g  e'/aiuatlen  of  t..‘ie 
ani  (J)  r"aiua‘,l.r.  .-f 
fiiieri.x  aunr-i  to  lovc.-it 
raiutf-.arird  r.ighl  te  co-nrit-er;- 
blUty).  •. 


.-x-nt  's-ni  contracting  practices  end  reg-clatictii  t» 
with  reliability  ctcectives,  H»’ee  re.-:iruati*,io.-» 
aec-r.o.nry  during  tie  st-ody.  So.-*  cf  Uw  fictc.-s' 
-.-ig  the  Jnolenentoticn  ..f  !XD  SiTrctlve  t, .  !a3S.lC 
•ling  Avn.-i  of  Initial  troducticn  Tar.*r»;u  fer 
.ry  Surpli-.-,"  -iaW  Hirch  17,  1955,  n*t.v<i8 
r  devciopernt  a  vi  proijctUm  STVt  t.he  pCs ribblitle s 

р. 'tentjnl  ccntracti-rs’  ability  to  prc-'.xe  reliable 

с. '-ilined  fuO  orod-xtio.n'contracts,  ti.  in  cco-^ 

—  Uio  evar-oii .ec,*t  indjil.nf  op'ratior.  «'il 

i.iifiit  be  netCrrined  or.  basis  of  rreiuied  reits- 


7*  InmstlcaU  pretent  preetleet  of  ptctcaclne  for  sbipMiit'  «nl  innsporUtto* 
Metiiodt  and  reconend  speei/ie  irprvvrnente  vtileh  wlU.  oAhaneo  roliab’llitjr*  - 

f-,  Investleata  the  effects  of  storage  of  elaetronle  eqvlpaeot  tpon  reXla* 
bllity  and  reeomend  liqsrcecaents  uHere  dctlrable* 

9.  RevieM  oretent  netbods  and  procedi*<ws  to  -itture  tnat  the  reliabili^  of  - 
equipnrnt  in  service  is  keot  up  to  the  Inherent  design  Jlevel>  Factors  trtileh 
night  bf  ineiuded  aret  (1>  naintenatKe  based  an  perfornsnee  neasurewet  rather 
than  to  neet  rigid  tine  acnedules,  (2)  narginal  testincy  and  (3)  personnel  trainlnK* 


SUMMARY 


In  antlelpntliBa  of  tba  Yariaty  ot  InUrast  m  ii^ptlnK  those  wlia  niU.  otndy 
this  dccunsnt,  the  atcrtirjr  has  teen  prepared  to  pet  nit  exsnlmtioii  of  the  Suk 
Oroup  flmilnga  frok  three  vleMpolnts*  The  first  part  divides  the  ob^tiva  of 
speelflcstion,  neesorenent  smi  nsintensnee  of  qusntitstive  reXlskility  into  tto' 
lilr.  areas  eovercd  hf  the  Tas>  Croup  sssi^nnents.  The  second  peri  provides  e 
eoBssrison  of  reisW  roeonwadstions  end  dt.flnitiona  end  dlseueses  the  ei«Rifi> 
esnce  of  the  sisUsrlties  or  differences.  The  third  part  divides  t)ie  TSsk  Croup 
reeoisaendations  into  cstceories  by  the.sffected  ecency,  terned  "proconnent 
sgenty,"  "centreetor,"  "user"  end  ’•Depertaent  of  Defenoe,* 


PART  I  .  • 

Task  Croup  1 ' 

fsslc  Crcsp  1  has  developed  nininuM-aceepteblllty  fieuree  tor  tbe  reliability 
of  various  types  of  Rllitary  eiertronlc  equipaent,  suitably,  ncpivssed  la  term  of 
hours  aojn  life  (aeaa  tine  between  failures)  to  persdt  inclusion  as  eontreet'«l 
rsoulreaents.  for  sMpborne  equipment*  the  related  value  or  percentage  up  tine  • 

Ih  also  given.  These  fifirrs  were  developed  by  detemlnlng  the  ndaintM  eeeeptsble 
probability  of  seeeeesful  Jtission^  tactical  (q:»ration  or  controlling  safety 
(^quirenents  throagh  liaison  with  ooerational  eonntnds,  foUowad  by  coaeorsion' 
via  well-considered  muvrleal  Inportanee  factors  to  ea.:b  aqulpnent.  category  . 
requlrt-i  by  the  nlsslon  or  operation  lurter  consideration.  The  coverage  of  types  ■ 
of  nisfiohs  and  tactical  operations  for  the  thrne  fervlces  and  categories  ef 
electronic  equlpaent  arc  representative  and  quite  coaprehensive^  if  not  eshauetive* 

.*tan  lives  are  presented  in  tabular  torn  by  equipnsnt  type,  within  eqaipnsnt 
categcry,  wllhla  Service  branch.  Certain  equlpnent  types  appear' in  aore  than  ona 
tabular  location  with  different  nean’ Ufa  requirrsvnta.  Accordingly,  proevrensnt 
agencies  will  face  alternatives  decisions*'  tc  standardise  on  the  longest  wan  life 
resiirenent  or  to  crccu-e  given  equipnent  types  to  different  reliability  requirewnts. 
The  techniques  eqpltqrea  for  developing  nean  life  requirewnta  are  fully  axplalned 
by.  acpendtves,  tfaia  peralttl'!);  otters  to  review  tne  technique  eaplofsd  and  extern 
it  to  additional  eqalonient  and  tactic;.!  situations.  'The  establishnent  of  ^nleuie- 
accer.tabllit'y  figures  for  relUlUity  in  terna  of  isean  life  is  conpatibls  with 
the  flniing!i  of  the  other  Tark  Groups. 

"m'k  Crow  1  notes  that  large  daia-tendling  systew  (SAGE,  !(aval  Tactical  • 

Ilata  Tvste.-.,  JJis'ile  .‘hster)  nave  teen  o'altttd  fro.u  conslderatihn  because  of  . 
K;-stt'.i  co.-rlexity  and  r»Tornends  ttet  futu.-o  attention  be  given  to  then.  Sy 
direcivoa,  cil.s'lie’rrrne  electrcnic  equlo.-w.'st  is  excluded.  Securlty-lensltlve 
ev-li  vnl  tjw  been  excluded,  as  well  as  noncorj^tant  equipment,  berau.ee  of  the 
corr-1--?- lens  that  w”uld  Intrsduce. 


;■>  the  Tns':  hreup,  tfeejugh  .nanioulation  of  's>ortance  factors,  has 
nlnlrsi't  **n  life  requlrerer.ts  fo"  the  varXou.e  equipment  caiegories 
-aVe  Ur  earn  wear«n  .syste-v.  It  urge.e  tnat  lurthrr  adjiat  ent  eteuid  be 


i 

4 


erinulctorM  hy  •  noi*  e«i^t«iil  MtJiorttjr  t0  taw  into  arjount  iWhlitiMttl 
f»^tor*  ralatlva  to  It^w  avch  a*  stata  rf  tha  art/  eai^roiKiaad  prrforwasa* 
wlntKiHnca  load  anr!  aven  taat  anvlronneRt*  TW  Grvbp  aufcaata  -that 
itm  taliVa,  «a  proaantrd,  ha  eduptarf  oa  tlfc  haala  of  tein(  a  firat  tpppti  f 
nation  {«rt*-r  a  ivyiaw  of  {•aranatar)!  and  ♦hat  infomation  faadbaeh  batwaa 
tartlcal  uoara,  aqulftavni  nanttfacturvra  and  prosiirlj|{  afraiaa  t>a  a^>lqiad 
a»  im  prliwry  haaia  fat-  any  furthar  adjuatofot  of  waa  Ufa  raquiraMota* 


Thsk  Group  2 

- a— ^  , 

Tlia  aaalierrant  of  Taak  Croup  y  uaa  to  daatlep  taate  ro4|uln!wnta  for-  taata 
nr  <lawioi.-a.tit  mxiela  to  prow  that  Um  daafgn  la  e««abl«  of  w«tli«  tha 
aaUbilriwd  «tnl»»4a.80oo(.u».Uity  fl«aw  for  rallabiMty  of  tha  aqiapaont  typa* 
A'-.'-onilnely,  iiM  Group  pr<v-o?ea  a  teat  whleb  haiandoa  teonoof  of  tlw  and  ■  i;- 
rarUlty  atralnai  the  rlpora  of  high  Mcuracy  and  rl*k  of  urong  daelaion. -and  ‘ 
ooin>lata  mlna  of  prootdiira  are  aet  forth. 

To  aaatot  1m  exaninlng  tha  propidoty  for  augwatlng  tha  taat  dawlopod  • 
t.ursuanl  to  Vw  ohjoetiva,  the  Teak  Gre«g>  paraphraaad  ita  aaalgnwnt  an  • 
fatpaat  to  -lavelop  ay<.luativn  naana  to  g^aa  aaauranea  that  unraliabla  a^idttwiit 
all  1  rot  he  raiaased  for  pilot  or  production  ruM^  IMe  panlttad '.the  Croup-th 
cornier  rarnprrfMBtlona  for  waw  of  avaluatlng  roUablllty  i.*her  than  kf  ' 
ral  1*1-1  Illy  tanta.  rreosnaniationa  to  lifn-ove  tha  validity  of -raliabUllT 

avAiuntlotj  *n-t  reconwftiatlona  fo-  Maya  of  l«v>roi^i«  rallablllty  eOnoaetad  utth 
Aijrh  toata,  Tha  Croup  tharafora' recoaw  .-da  that,  in  addition  .tb‘ the  propeaad. 
lont,  •  ^viaw  ha  MMla  of  the  raliahilit:*  predlciioh  praparad  diirlJ^  tha  detawd- 


la  tita  baa  la  of  <leclaion  .Vtr  tha  follonli^  raaaowt 


(1)  Tha  fact  that  tha  ttoa  and  the  nurier  of  nodal/.'  Ulabla  for  taat  art 
.Jinilad  Piavaa  oixiaJ  «pnri.**nca  llnita  on  raaulta^ 

(?).  Tha  davblopMant  ie>lala  are  npt  neeaasarily  rapfufsanUtive,  aa  futm.- 
raohk-tlon  will  uniout-tadly  ha  ^ron  dlffarent  loU  of  parte  and  aiU  te  ' 
•c'.-M'i-l»iiod  with  difiarant  procaaa  cchirola. 

t  '  *  ' 

(3)  Tin  fatiura  pattern  of  tha  developnent  wdela  la  not  necaaaarlly 
a-(-f«arntetlve  rvan  it  all  lote  are  coneiderad  identical,  alnca  only  *  anall ' 
nj--  a.  ..f  tha  iMngr  pcaaihi#  eutasonan'.wriaUow  within  the  tolaranco  Unite 
VI  I  l  -jrrur  i„  , 

6roup  prerides  doteUa  for  a  gareful  ravia*  of 
.•  «itei-i:ity  prtnilctlon,  haaad  .>n  «  rariaw  of  paper  deaign,  and  a.  progran  tw 
'-•■-t  -ivnl  te.-tt.  V)  fhUiira  to  Identify  failtire  node*  and  araluate  safety  faatera* 
'iir'h-ir,  tlwjr  racomaf.1  tiwif  a  n.iaoetent  enclneerlng  failure  anhiyats  ba  narda- 
•■r,  r<-r  all  tr.t  failures  In  ar-ler  to  Ir.itiate  adequate  corraetira  tetitnu  tha 
larot.-rikij  uoit  ell  n-coira-nded  reliability  setlrity  be  stqwrvised  by  an  ' 
vvj<  jiistioi:  pro.a»  lint  is  not  subjact  to  the  Intereste  or  prejwllcaa 
■ i-i  >ft  per.'i  -n.-wi  on  t»«-  -teffa  of  the  contractor  or  pr-->eure«nt.  agency. 

f'.ir  ilM>  fallura-rate  test,  the  Task  Ctoup  provides  rfcoanandat.lcns  on  the 
-)-i»i>-r:i?  I  ha-wi.-rlst. ca  to  t-e  eraaure-l,  the  nunber  of  acxlela  to  be  tested,  tha 

e-ivir.-i-%  lit  t...  te  er^-j.-ye,},  tJie  proper  definition  of  *’falliL-*e,"  test, 
-.i-lj-.s-n  vr’.lrrSe  e:4  .let*  itarrfiln#;.  All  reccrrarristlens  flppaar  t*  be  suf- 
l'>  tei.ny  .’rt-ulr-i  VO  oarett  iiytr  satisfactory  ii^lesm-c-ttlon  on  tha  basis  of 


tlw  euatoatrr  MiuipMnt  0p<clfle«tl«n«  ep^tti*4  Mfi  Ilf*  (from  last:  Oroop  11$ 
and  ttK  fio&l  report  of  Task  Group  2* 

Procurewnt  asencles  tbas*  r«eo’*MRt*tloi»  shoald  (I)  add  a’ 

re'^Jlreornt  that;  all  design  rMo/rwndatlonc  rosvutlne  froa  thr  test  /n>gn*  ha 
coreiifroi  ter  ineorporaticA  into  tor  (roduet  daslfn  and  (2)  praacrlh*  a  eoura* 
of  actifn  in  elreunsttn6es  vtara  devalnrarnt  nodala  fall  to  paaa  the  teat 
re'piirenentsj  to  the  extent  that  the;  are  ^udf*d  ureiatahle  for  pilot  dr 
prodnctloa  run*. 

Taak  Group  > 

?n  accordance  vitb  Ita  aaslf mtnt.  to  doealop  haalo  rcqulreasRU  for  tost* 
of  pUot-prtaduetlon  an*  prod^ictt^n  nodala  of  alaetronle  equlptuni  which  wHI  - 
pryvo  coneluoi'el/  that  the  w<ptlpaent  rill  aeet  the  ■astabllahed  (dnlfaua* 
acc«.!:tablUty  figure  for  reliatilit/  of  tne  eeulpaent  type.  Task  Group  3  aidMitt*  - 
epeclflc  testing  netbodSf  togftoer  with  essentialljr  all  tea  datalla  a^ooaaar/ 
for  their  loplanantatlon* 

tba  reeoiuaended  testing  nethoda  provido  apeeific  routlnaa  for  (1)  r«lla*^t^ 
Index  {hean  Ilf*/  evaluation  of  ptiot-produetJon.e'pilpnent,  (2;  rollablUt/  IndK' 
evaluation  of  prod^tion  equipment  and  (,»)  ijfwjevtty  (Uie  oqaipaeni'*  ueofttl 
aarriee 'llfa)  evaluation  of  pilot-production  and/or  production  equlpivttt*  Tkk 
test  routines  pernlt,  rerpactlvely,  the  oatahlla/inent  of  (1)  Mio  ecttl,>**mt<«  '  ’  _ 

cacaSllity  of  naetliv;  a  nlnisaw  reilatlllty  represent*  tarad  upon  the  irunt*^ 
eeonosj  with  respect  to  the  trifi/tr  of  aquioneri'e  tested  and  the  tnating  tlM* 
required)  (2)  atatiatleally  conclusive  proof  teat  an  acceptable  pereentae*  of 
quantitj-producod  oquip.vent  MMts  a  «i;>i..Mr  •  ^ilit/  requireiaent/  with  Mslauu 
econaty  of  testing  cost  and  tisie  an*  witl  np  Nalting  tlMe’’  for  test  risralt* 

and  ii)  conclusive  proof  ttiat  •quipnent  reliac  .y  does  rot  degrad*  below  •  ps** 
scribed  Rlnlouit  level  during  the  desired  lif*  of  the  cquipeent* 

Testing  procedure*  arc  dewloped  so  that-tta/  are  reaaonabljr  iwuna  t*  ' 
ta-xering  by  the  contractor  or  by  prejudiced  testing  rtersonnel.'  ly  nean*  uf  ' 
Selected  rodunianeles  In  data  ha;>dllr4r,  the  testfAg  netneds  are  rendered 
reasonably  setf-chijeklng  an!  <»S!vne  to  errors  in  data  recorrllng,  Speclfle 
nearis  foi  acro;isllshlt^  th.»  e’ctiuatienf  are  in  tf.».  fwa  of  dofsllad  teating 
ae'vo-is,  clrcu.’.scrlljed  by  cosfjlete  rules  for  ad.'d.nlatratlon  and  probrdure* 

The  only  eltctlrt  naransters  left  to  tfic  prw~"^.ng  agency  are  those  wnleh  ’ 
iSmilfy  ^inlnun  i«>an  life  asd  tne  extent  of  pilot  prcdyctlon,  re  lata  condition* 
of  Cf/icc^nt  end  use  to  the  testing  crocedur^  and  r»i*te  ccndltlone  of  pro* 
eurearnt  rolune  and  sc'icJullig  to  Vra  testing  secjence.  factors  that  cannot 
affect  eraluatlnn  Corir.l;¥!l5~  tut  can  affect  testing  r.onvenlanrs  ars  left  for 
alcetiof.  ty  UiC  procixing  agency  or  ira  contractor, 

T.a-  Task  Croup's  ssslg.-vrnt  reqairrs  t:iat  U<e  prcrcscd  teats  provld*  eon- 
claaiv*  pruuf,  Tne  recoiranr.'ed  tests  establtsn  froef  tc  s  degrew  of  eotxrluslTSflass 
that  is  ciistonarily  occeptad  by  esti»t.ie,oe.d  qaai'.ty-c'/ctrci  retinas.  The  Tssk 
Cfuup  r.as  provided  ail  t^ccsiary  rortjuje  tc  teat  revision  so  as  to  redue* 

t-Te  rise  .to  the  procurrnent  age»;y  anri'lr  cuotrtrV/r  t  .whatever  degree  la  eon- 
si.*ered  de-lrttbir  to  acMevs  f.uck  *dd!tlcr*»l  co nr iusi/e ness  at  added  o;q-«nss  as 
3»y  be  uea-siary, 

'ii-'.  C-icq)  rpcoKiend.*  t,v*t  trial  liqplerv'ntatlo.cr  te  run  concurrently  on  both 
th-  •’rcc'-nei  oilr't-prod'jctl.'o  ^r-i  t.-w  prodactlin  teste  by  f.eiocttng  a  varied  group 
of  rr:'"  r>  v.ct  contracts  on  which. th.-  rella'lilty  teste  say  K  wade  iBniitcry, 

It  fu,*-..'.5r  reco.nr*-fldad  l.uat  tr,j  t»f  t  elrcttu.'iB  .w!e  ty  t/.e  procitrlng  Sj'.edry, 
thn  t'-st  once  by  the  cc.ct'acl  r  »nd  tr.,  firvitnes  t*  revlcwsd 

a.'.d  cc-';are‘  --itfi  later  field  obc*-.”.  If  t- "y  are  fuun!  eatlyfaet.e-/,  then 

*..■«  te'Vi.ng  reqalreiw.-ito  .■snculd  !>•  •tslfor.siy  arpiicd  v>  *K  eirctrerde  proctirsnent.  . 
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If  T|  ,1  ii,  faiaiaAa. 
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Tfcik  Group  4 

Tix  afsten^rtt  for  tksic  urrq;  «.  v«s  to  lR*«8tl£*t*  «ctf  rvc.-aocat  vt 

fpocl.'yi.ie  ^iotttVicoent  ^trocrdhxrot  tc  osture  that  o^patst  deai^pm  bnj  tht 
ri:<;xirird  it^rent  rrliatUltr',  $s^st«d  taetara  rencf^ocationt  at*  (1)  - 
,t.xec'n'tic»l  prCf  Action  off  (2>  thorough  8o>etic.;.,  ')i»atfieali»a 

aid  ai-plication  o?  cc^^sarats  ':t  spfcltie  clrrnl*'  and  taritumatA  rK}«!r«nMtaf 
(3)  a-U-q:;atc  signal  Irrels  aid  foedlacic  and  (It)  rcdt>£V>«fl  vf  tht  effteta  of 
.  ni^hanicsl  r hock,  vibration  and  .on  er.ttioal  coapoorata  ,ta  tte  laatat 

oosribia  degree,  ,  .  ’  • 

In  coi^liar.ctf  ihe  task  baa  subdlM  racomnded  daralcpNaal  ^ro«  ■ 
cedures  In  t  cllitarT’-atandari  fcrait.  Tm  piveedurea  divide  tha  dnalopatst 
prcgrsv  into  (1)  *  ftaslbllity  at»<*v  {ftaa*  1)  which  Ineladea  thaeratieal  r*Vta> 
billty  prediction  and  la  tersisstet.  oy  a  report  and  (?)  U*  daelga  aad  eenatmctloii 
•of  rrctotyro  nodela  (Fcwe  an  acrcnianee  with  specified  rsqulreNaRts  fcr 
thc'o-Agh  aeleetfon,  t'Jallflcatlor.  and  appUeaUon  of  coipcnenla  la  halaetad 
oiroulte  and  In  anticipated  ecrlrcnaents.  together  with  reqvirewnta  for  dlH^at 
appraisal  to  rai-st  t:<«  «rfe;ts  of  wciiarileal  abock,  tihratibU  and  taapmtBM«  - 

While  the  proposed  etaadari  cstlines  explicit  aaana  fotr  tha  tMataeet  -of  - 
failitrc  rates  on  a  9»ntlvttive  baai.  In  ordar  to  arriiw  at  a.  ntMMdeal  realaMU^'. 
fredietioa,  tl*  renair^a;'  ’fevelcpaest  procedure*  are  c^idered  on  a  acre  «9ali» 
tative  th,n  <;usntitaUve  btais*  Tbe  scope  of  coverage  la  coiftarattecly  i.ef>ppa-' 
hensivc>  although  the  tsvataent  cf  each  Iten  considered  la  aufflcinAly  abbreviatad 
to  sake  the  specif  icatica  nsefnl  fer  rapid  refeianea,  *  • 

.iitiv>;gh  Tnslt'orc^p  St  recc-meids  that  tha  ?fcasa  I  report  aa  fotod  atttfpUSit 
before  the  contractor  is  cctf^oriaid  to  procead  with  Fnase  the  speeilieatlen 
hor  been  fr*parel  In  a  ftanlcn.  vc^s  persits  heginaing  Ffaasa  H  wU3a  awalticg 
ariroval  of  the  Phase  I  report  ty  tea  eustcaer*  '  ,  . 

,Tr*  ureup  eit^hasites  tnet  toe  first  step  In  developing  reliable  e^dpse-tt. 
is  to  rake  the  contrsetors*  er^iseers  thcrpughly  farfUar  with  the  ennrona*"^.  ' ' 
in  wnlch  ft  is  to  be  osed;  the  cxoected  nalntenaice  couiitiDna  and  aerating' 
rrcbieaj. 

T!ie  rail-  rial  sxb-Sittec  cy  Tish  Group  !:  la  in  a  fer*  tha,  la  awltahle  for 
disssnirtstion  l:vie;e.-viently  Cf  Che  ether  Task  fircupw*  finding*. 


Itsk  grta.p  5 

fosk  Jto'^  5*s  assignment  was  to  establish  criteria  and  methods  far  ssecl- 
fv'.ng  tie  rciiiMlitv  of  -c-rr^-.t  rarta  aj*i  t'^s  in  ten-as  of  failure  rate  M  a 
fu-vtion  cf  tire  and  er.s-irtt.-r.'t,  since  thia’ia  ronsidcred  essential  to  a.  deterwl- 
nution  of  t-’u*  anc-x-.t  of  i.i  rocen  r.*  denenied  to  aeet  t.ts  o\vr**ii.  reliability 
rcx-irp-VJta  cf  elrctrcrf..'  er-ic.vr-ts.  After  careful  study,  Tssk  Orew  S  finds 
t;ji:  rrejf.'.t  .uliUrr  !.-eciric*tisr»  d.>  act  osjure  the  aeMewne.-.t  cf 

•.r»jrfn;’jr  r«-cf“i  rei-xVi.'-tf  _<vels.  te-^-orier.t  ccailflcatior.  Moprcsal  results 
ii  t-nir  iinitj-j  r.'o.'f  cf  r;-.  .-r-t  Jfrlgn  copbility  a-c  it  prsvifej  rts  a's-ursnea 
f  any  te’eriiiibi*  fiii-ir*  r»i»  cr  erspenent'  reliability  at  ary  level,  Prejfnt 
lil'.vtry  liinvcoti. it  occordsae'e  with  t.'icse  speetflcatio.'s  do  net  peliea 
r'lia’. lilty  >v*ls  t-v.  y  rid  -vs  Jata  for  reiiatlUty  essnrance, 

•  .  -  t 


Ptrtovmxt  r«<;ttlreiients  cf  pr*Mnt  atltt^ry  ec^^wnt  sp«etfie*tioa>  d» 
not  t«f>et  prcoont  r»H]uire<«iftii  for  *ttA  use,  end,  wlto  ttie  United  InfornttiM 
«t  hAni,  It  .if  IfDossibln  to  rerls*  those  speelfisatlon#  to  rof lec  fe  Jiueh .« 
relatlorehip  i.-!  a  sUttstieali;  vaUd  nannor.  .'Methods  for  environnmtaX 'test 
0/  co»aa>nt9,  as  contained  la  specifications  XL-STi-SO!  and  HL^Z-Xf^io  noi 
ptrsii'  the  esUb'<lshwnt  of  falltr«>rat«  oatSf  nor  do  they  correspond  to  antiei* 
p3t«.l  envlro»vntaI  eondltlo.is.  7ne  fallm  rates  of  fKst  pi-esent  nUlt&ry 
eos^onests  (ond  the  aaterlals  of  vnlcb  they  arc  cot^oeed)  for  slncl*  envlrorMcnte 
are  sroeraUy  unktavnj  they  arc  entirely  unknown  for  cei^lnMl  •nrlreanuts* 

Ossenven*.  rosuiatlons  on  drafUnc  eoi^wnent  specif Icationo  enst  be  sneadsd 
before  thoee  speciflcatlOBs  can  estsbitsh  reUablllty  re(;<tirstients  bssed  on 
failure 'rate  lnforrotlon«  To  be  useful  to  the  eq>«ipaeRt  deslfccsr*  ioCemstion 
on  failure  rates  of  eit^aptnts  axat  inelcM  (1^  t'O  percont  that  foils  per  unit 
tinct  (2)  the  critical  failuv  aode»  ot  nadetf  or  tlw  poraneter  cliahge  to  Mleli. 
this  failure  rate  applies  anl'd)  ths  relotiensnlp  of  thin  failure  rate  to 
cnvlrenwnt*  •  -  . 

Task  Gt^rup  5‘  has  provided  a  tost  procedure  for  deterftinlng  the 
of  e(  j^DsnC  parts  and  toh^s.  either  in  terns  of  fsllurs  rate*  which  nsy  b»  ussd 
for  ecuipmnt  reliablUty  cslcuiatlon  as  tecornenled  bj  Task  Croup  li,  or  is  spociol 
para-iatrie  terns  that  aoply  to  equipneat  reliability.  .  The  :)>t>lete  derivation  ef 
this  oroeedur««  fron  i  sUtlttlc^  standpoint^  Is  ineliidsd* 

to*  Crc-iB  rscoaniR*'  *11.^  ncUon  toward  scMavlnd  rrilabHity  of  eetpeneUt 
.parts  «.ti  tubes  be  err  .  with  teoebrary  Measures  tp  nlntaln.tho 

prsasut  'jesree  of  Inhsr/r,  relnbiUty  throteh  *  nerc  critical  inspection  proeedw 
ana  thnuch  acniannual  rc:^LA  .flcation  with  greater  enehasin  on  relisMll^  rntbsr 
than  q.tUty.  At  the  sane  tlne^  anr  spe'.ifloatSom  should  be  prepared  to  re^utos 
„a  scaad  iva.luation  of  fail'jre-rate  versus  severity  of  teat,  .'..i  sttespt.sboHM  ho  ' 
n.'.ae  to  p'epare  s  new  standard  set  of  test  envlronnents  fot-  sU.  cosponrntn.  A  raw 
systen  {>'..11  be  developed  to  detereine  an!  identify  arproved  suppliers^  based  on 
l.»»plant  quality  control,  with  a  r.«rlo4ic  rcdeterodiatloa  of  approval  by  •  review 
of  In-plsnt  qua-lttr«contral  reeonis.  As  part  of'«  revised  qualification  approTsl# 

.  a  large  sa^le  of  the  product  should  to  tested  te  establish  primry  foUure  rates. 

task  (rro'.q>  5  further  recovieiJs  that  a  yeraanent  group,  at  Separtorit-  el 
ilefertse  ls''»l,  te  estscllshed  and  funded,  that  it  be  coioosed  of  personnel 
rtpn  senticf.  iad’jatry  and  the  tAtce  Services  la  the  fields  of  resesirh,  d'-veisp  • 
nent,  sUn.UrJiratlon,  procure:«nt  and  quality  assurance  and  that  this  group  ba 
ebergej  vlth  tir-  task  of  dereioping  .tilitary  ccrijcnent -specifications,  testing 
cow.'oasr.t  pqrts  for  --lesion  cfipabillty'  end  developing  Inspetction  Methods.  '  Too 
group  snouid  aceunulate  usage  reports,  failure  report*  aal  reports  o<t  controlled 
experl-Tentj  •‘cr  use  »n  MORitcrlnp  the  cotreiallen  between  ?peCinra»..ons, 
Morjufactjrfrs'-quaiily  ec.ntroi  anrl  observed  ''atn.  In  erder  to  control  the  con* 
tinuation  cf  each  cos^a'.tt  n^n•.;^^ctur<r  on  the  ao.orovad  list.  The  vork  of  Task 
'Orc-up  5  s.i'.uld  ie  eo-tti.'ioed  by  ■  peraene.it  cc'.sJttee  cf  <j«:ustrlal  and  nllitsry  • 
repre *»r.t3l;ve'j  vlth  poiicy-.-^king  pewer.  This  coanlttee  shculd  review  the 
present  aillt-u-y  effort  to  coorilTiBte  ano  ellrdnsf*  du,-\ir»tio.»,  *ke  reeoM- 
i»er.!..tlc.Te  regirii'v:  t!if  nerd  f-,r  c--^'-ra-:ta  to  do  specific  cutside  work,  establish 
vesra  for  llvsesi'iatisv;  lnf'rna»lon  and  establish  policy  for  the  crealii-n  of 
ccr.trOiiirg  d-cu-v.its  corra/uca  t"  specif  Scatlonr  which  contain  use  and  appli¬ 
cation  notes  for  riigh  reliability  and  .*i<eci8l  enviror.-ents  not  covered  by  too 
specif  ic.ittorw. 


TibW  Orot»  t 

thr  »saisn»at  tksk  Qrous  6  tos  t«  st»d!r  s:«Mnt  pfecurtatat  •ad  ««i>  . 
traetiJ^  r-raetieea  aaS  wpulaiioaa  to  rtetorcriaf  ttoir  wfth 

roiiabiUty  oaj««tiYa*  anl  to  .f»k*  for  «pMlfle  •?»!»."*«•  «• 

'oa!«l  aoceasvy*  Tht  Oroup  noted  tbot  sene  ef  tae  fsstcra  Inveived  nicht  b* 
th#  foilawingi  (1)  «s»ejj»at  of  the  Is^rlonesu^tea  at  D®  Sirestiw  Ko*  -e 
2U.'3S.i3«  "A!^ltfie*tl<sa  of  Polity  Gtanersinj  iiwri  of  Isltial  rrod  jettoa  Coa-’^. 
tTAaU  for  Technic*!  cr  SjeclAllied  .’aiiury  Artltca,'  (2}  eontldtnUoa 
neth>l9  of  ooleetinc  contractor*  for  dcTelapaest  aai  pivduetlon  add  th* 
posslbUltle*  of  ineluilne  an  evnluitlon  of  *  p.‘t«stlAl  contract  V’*  abtlit^r^ 
t~  erodus*  reliable  de*tcna«  {)}  arxL^tlon  cl  ccaCine>i  itk!)  aroi)ictio&  eentraet*  , 
and  'll)  eansideratioQ  ct'  over* *11  cott,  c-eratlcn  aia  aidataaanea 

Xi^  baols  of  predicted  reliab^ity}»  when  ccmiVrliaf  an  award  \i»  th*  lovact  ' 
biddar*  •  ■  •  ,  •  • 

The'  Taak  Croap  la  eonrlneed  that  reliable  elactwalc  equlpaeat  cannet  bt 
pf*>cv8eo  >nl*a*  tne.  coatraitins  officer  can  iaccrpcratu  ip  hie  contract' a 
coat'rehaiisive  aet  of  technical  apecificaiioa*  «a:ich»  it  aett  will  prodvtta  It}*  • 
de>:r*e  of  reliability  r»<iulf*d.  Ta»5c  Grauo  t  flni*  that  axiatinc  proemnant 
low  and  regulatloni  are  ade^oate  and  Cufficiestly  ^xibla  to  p*rad.t  tbav 
aeaectioft  of  fvUy  (jjalified  predniere  (with  ^«ect,  to  reliability),'  •apeelally’ 
if  all  oroeurinK  ajencle*  tat*fornly  intarpref  M»d  i»l*awit  niietisf  guidance 
doeunenta  of  the  lipartaent  of  tJefenee  and  the  Cf.tce  ef  *>»fema  .'i4:iliaatleti*  ■  ' 
Tiiuc,  while  not  recoirawvi't*^  ^  baaic  cha:^  ia  Wfolbttcw,  the  taaV  Croun  '  ■  . 
does  atrenely  leaeanend  atanfardisind  the-  inter^tation  of  each  claoae  la  tbe'^  '• 
Araed  Scrrleea  Proevaenent  Seg-dlatiom  a^vtic  all  of  tba'  mewing  Serticec,  '■  < 

The  Crovp  beliracd  that  proeurenent  apenciea  can  4W>ioy’’'th*  fiitiinta  of  Thsk 
Greuns  1  t^tfough  5— in  the  forn  of  *feaificaUcw»«to  orocue  re'ilabie  aquiwuta^ ' 
ymeorenent  tool*'  presently  aentlable  to  enace  iTt^reeH.  reliability  «e«  \1)  tb* 
use  of  eeat-tyue  op  redet»rrtinable  contract*  during  l^t’a!  pre^tioo  ram,  (3). ad 
ability  tc  contract  for  e'a^nslT*  testa  dcring  riltt  fane  apd  prior  to  fall  prc»  '• 
duction,  (3)  careful  seiecticn  of  highly  cualifief  eontraetore  by  using  a  procedur# 
which  evaloatca  tne  ccntracts'  present  and  potential  capabilities,  iuj  restrlctiCh. 
of  ca-TCtlt  Ion  to  olanned  s-^pliera,  once  the  bare  has  been  established,  (5)  pro- 
Tiaicn  Car  cp?ratto:ial  tests,  4.<  ncedc-ij  eric- -to  accepUnee  awl  (Pi  prorlalon  in 
ttie  pro-i-oclion  contract -fer  a  pfcfran  of  ccntlAed  p--<j’iet  ievroweneat,  baaed  op  t- 
controlled  tasting  and  field  eaperlfnee, 


Task  Group  7 

T±»k  Croup  7  was  eJurged  with  'liivestigaticg  rre^nt  practices  of  pkchaglng 
for  shiomnt  and  transpcrtatloi.  4etf.od*  a:^  ieccoaeajli^  iTrovcnCnt*  wher# 
desirable, 

irung  the  subjects  investigated  by  tne  Cro'up  were*  (1)  the  effect  of  closer 
reiatienshin  t«tve<»n  eqult-ar-.t  designers  and  englneert,  {'I'  11*  present 

ahcrlage  ■’f  Infornillon  rn  cusnioning  tc  ■la-T-eS  •.ywr.c  forces,  (j)  present  pro-  . 
gr-.-.5  15  obtain  better  field  >Uta  cn  tne  rarasreers  .-f  encountered  svasit  and 
vibrntiir;  luring  nandlinf  a.hd  trsnrr  jrtati--:,  i,l  ;  tnsge  experienced  ty  '‘■crTiea 
'^►erlel  d-.rlng  roug;.  f-a.idling  and  'tr-irait  lecsore  cf  lack  of  adequate  blociclr* 
ani  briciag  of  eTuipnent  -acks  vltnin  the  tri-cpor-taticn  'nedta,  (5,'  toe  dsrelop- 


Mnt  ftf  apwifie  tMt  pmctttnB  to  ivr*  eltur^  tiMdLato  tnu«;>ortati<^n  uii 
twnrtlinc  «)iiirln>iw>i''9.4.'t^  (»}  toiwral  <t»is£o  (h«  to  liy>rop«r  |«et(itclnit  ord 
puklne* 

•ts  •  rttalt  •<f  t>c2#  lovutlcatidriBt  ths  Tuk  Croup  hu  moo  i««er«} 
neoMwtKiotloiis:  rcXAtloao  tetufen  ti«  eqidpaent  desi^MF  and  tto 

ptckAco  daji^r  !>lK>uXd  be  ecntinued  and  CxvbMis  on  ii^rorlng 

eonUlntr  dosifa' should  be  eontlnuedf  with  an  effective  feedback  from  present 
studies  cn  encoumored  eheck  and  vibration  (htrinf  handjiinc  and  tranportatlon* 
There  should  be  ic^^roveaeat  and  «nri<n*eMent  of  4ll  requlrenenta  for  clovldac 
an)  bracli^i  as  contained  in  all  at^lloation  retulatione  and  tariffs* 

The  specification  am  in  prci-aratlnn  eoverinc  tost  proeadiuoa  for  alRulatioit 
of  tranapartatlon  and  banil!:^  environnente^  should  be  cotq^leted  at  npidljr  as 
poasibls*  Finally,  the  'Sssa  Group  reeoasvnds  that  elosa'  coUate^.'sMon  be 
mintalasd  bea.-een  tu  Ccvrransnt*  the  equlpwftt  deslfiter  and  the  eontainer 
designer*  ‘  . 


Task  Groi^  (t  «as  asked  bo  InMatl^ts  the  effects  that  storage  tes  i^en  the 
eXlabllity  wf  electronic  eculpasAt  and  to  reeonnend  desired  irproveaents*  Ss*ed 
Upon  Ite  study  of  fsllure^data  mcoi^  on  equiownt  stored  by  eisht  acenclec*  -Uis 
‘Task  Croup  concludes  taat  frilures  in»  atonic  ars  not  sicnifieiCit  in  cctyiarlsoii 
with  other  failures* 

“A*  t  '  ’ 

Tlw  Croup  found  that  available  data  recorda  vara  uaiiaUy  quite  iapeFfeet 
wth  Hith  respeet  'to  ldenbl!yifl(  thoae  failures  specifically  chargeable  to 
storage  and  the  roRber  of  equipwnt  ctcred*  In  fact*  the  greatest  bulk  of  data 
(fbon  tha  Air  Keteriel  Coauud)*  eoverlr^  10C>000  failure  reports,  of  ,i(hlch'lt!>li. 
Were  attributed  *«  stersf^,  contained  no  inforuition  on  thr  total  numr  ef 
■  equipmnta  fron  which  the  failure  reportc  were  drawn*  Thus*  it  was  necessary  to 
estiaste  an  over«4ll  failure  rate  of- 5  percent  in  order  to  ^duea  a  quantity  ef. 
two  uiUion  eqttipaent.1  ani  -te  conclude  that  the  probeble  storage  failure  rata 
vat  not  more  t.  .n  0.02?$  pereenv.  Sumarlscd  data  from  all  eight  sources* 
including  ttw  foregoin;  essara'tion*  as  well  as  ethers  nseded.for  statistical 
conclAislons,  lisflcate  9?0  failures  fro*  2*lil»9*772  equlprants,  which  permta  a 
statenent  of  00>pereent  probability  tliat  thr  atdrage  failure  rate  liet  titween 
0.035.  and  O.OijO  percent. 


The  Task  Orevg)  notes  that  there  tre  considerable  data  in  nilitary  fUea 
which*  if  converted  tb  a  sta-...iard  forti,  could  be  nBcblnr-processed  to  yield 
isyttoveu  statistical  conclcslone  ceneenUng  failures-  resulting  flron  storaga.  ; 

In  fact*  the  analysis  of  such  data  veuxd  pruvlde  th)r  principal  justlficatioii 
ior  its  past  collection,  the  Groan  further  notes  tlet  field  lirpeetion  and 
Mlnte.vtnce  pt»ivlded  to  assssr  equipment  operability,  w5  thin  perforaane#  linite* 
should  include  the  regular  sab-deslon  of  .reports  of  findings  as  a  basis  for 
.nodlficatlone  in  design  and  mnufac taring.  ■  .  '  .  ■ 


i)n  the  basis  of  a  portion  of  ♦he  rf.ita  examined,  tie  Croup  believes  thet* 
NfC«u.*e  of  thr-  variation  in  cec-Jt  y  awl  precision  of  test  equipment  used  in  the 
field  and  In  storage  tests,  a  cc  jsldrrable  percentage  (st  least  20  percent)  of 
the  rejectioii  aw*  acccotsncs  -iecislc.ie  iwde  are  proWbly  Inva’id.  It  is  believed 
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that  there  ie  a  biLSle  leek  «f  vnlerttaall^  the  part  «t  mumetmtA  ^wcardloc 
the  need  for  the  eal't  aa*  i|ieelfle  dat*  tha*  art  rtqnirad  for  rallaUlltir  at«U!« 
and  Mttaatea* 

tve*i  thoucb  deteriarattan  In  reliatilltf  dttriac  atoraije  is  not  conalharad  a 
alcniflrant  problea*  tje  «a<ea  the  frllcwlnc  rceonnendatloaBt  .  . 

(1)  The  apn^slljr  vlicepread  philaaxh^r  that  aik^te  and  TaZ!d't«ettn(  ^ 
and  reportlm  are  not  au.lJlta.y  funetloot  of  priaar/  iaieirtanea,  aeaa  dsris( 
peaeatlae,  ahouid  be  rertwad. 

(?)  Test  ad  Inrpeetios  re<)ulr*nef&«  ahculd  be  relieved  and  aaesdei  to  ' 
provide  the  data  aaetstST  reHalillqr  at-csdlcs«  these  data  to  be  Is  a  fcrA 
convenient  fot  reCxtlor  am  aaalyaie,  am  tofticlani  authority  ahsuli  be  Taated 
in  qiMlity-eontrol  orpariaallsna  in  all  bnintaes  of  Use  Service  to  eneec*  tUi 
proper  collection  of  tsen  data* 

(3)  A  planned  pro;r«<  for  reductnc  and  analyxtiy  data  now  on  file  ^ould 
be  put  Into'  effect  at  as  early  data*  .. 

(!i)'  A  centraxltad  croup  with  the  OepertiMt  of  Defenee  ehcold  be 

establlahad  on  a  ectV.is;.l3C  basis  to  eocrdieate  aid  avelnata  reliability-  data 
from  all  sourcca  to  ene'^se  peeper  and  proapt  action* 

(5'  ‘fhe  pro(r<v'c  propped  ^  Task  &ctp  8  for  rtecirdloc  all  field  teat 
operations «  even  in  tbt  absetnee'of  /ailiirt«  should  be  considered* 

.  (6)  The  Advleo^  CdVtf  on  Rellablllip  of  Slectreaie  Equipaent  {JUEaS}  ahouid ' 
consider  a  controlled  esperinant  Involvinc  the  etorace  and  tastinc  ^  h  statlaUcally 
slcnifteant  saiqjla  of  tysieai  electronic  equipnants* 


Tcdk  Gronp  9 

Task  Group  9  vas  charted  vith  revievinc  present  natheds  and  procedures  to. 
assur«  tiut  the  reiiatility  of  eqv'tpnent  Is  service  is  kept  .4>  to  the  laSarent 
design  level,  ani  it  wts  st^sted  that  the  fcll^vlng  factora  night  be  included* 

(I)  naintenanee  based  cs  arisurerti’t  of  perfcrrence  rather  than  on  neetisg  rigid  ' 
tine  schedules,  («)  narjlnai  testing  and  (3'  personnel  training*  Iceoriisgiy, 
tlie  Group  aade  a  otui/  ri  ecu^jnent  nalatairabiUtr,  nerforna:*:e  'du<ti:^  and 
perfomanco  sumatris..  i:5p«jsable  nodular  rtit*  and  tcst^equlpnent  ca.'itratione  • 
as  well  83  supportir^  sotcriAls  such  ns  sair.tenanca  pi^llcktione,  naxals  and 
liandbooks*  They  a^so  preventler  naisienance  ani  narglnel  ehecai.'V,  the 

shortage  and  trai.uag  -f  iervlce  technicians  a'»..thft  education  of  e.'tic»ers.  &> ' 
the  basis  of  lliese  st'tlias,  the  Croup  for/attat«d  'a  wide  variety  of  recriVkCkiationtt^ 

.  The  Task  Group  re^■^s^»tGs  that  equlpaent  centraetors  be  required  to  deae*- 
strate,  by  r>;sne  of  a  yrvfcrlbed  test,  taat  tselr'equipnehte  seet  sp^rcifted 
aaintalnsbillty  roiialr!ae->U  pricr  to  qaa-iUty  prodaction*  ^ialr.talnability  Is 
deflnel  as  the  reci?r>ca':  cf  -sean  net  tine  to  repair  fsiluns,  r+iere  'v.-tc.  tes 
failures  and  the  re^sir*  take  place  under  •perifled  simulated  field  coaiitiow. 

It  is  recociieivled  ViA*  a  s--jzj  be  nsJ'  tc  evul-vite  an  absolute  average  tecssiciaa 
on  a  cofUDi.  basis*  Ttr  -r-'ur  also  recoiseeTd:  that  a  figure  of  nerit,  tsrnel 
"Opcratlo-j  Vs.lue,"  be  rctrctcd  f,'r  each  equlrne.-.t  prscuresvnt  program,  taci.-ig 
Into  accvint  rv!in*At;aLVllity,  failure  frecje-cy  (reliability  iadex\  recwoe.iled 
prov#;itive  rtaintcnance  a-ei  *«ti.-.t«nance  Interval,  operational  cliev-iclnf  and  shecklng 
interval. 


Ttek  Orotip  neon'*aiB  t>Mt  •  m^nijan  nueter  of  p«rforMaeo  Inkxoo  te 
H*sSk^it«i  for  etch  «.iulorrnt  class  ftfid-  that  sseb  tijuipnsnt  specification  . 
e.Tjaarate  titeso  Indexes »  with  provision  in  efttdpnsnt  for  ehecklne  then  in  thi  - 
fulect  and  aost  rcpld  fashion.  This  woul^  eonstituta  the  perfcrasnca  standard' 
used  f:r  perf-^i  nance  'heck  after  every  ralntenance  operation,  flsst-equlpnani 
calihrstlon  centers  should  be  established,  and  handbooks  on  teat  equipnent  ahould 
crcvtde  easels t«  calibration  information,  with  aecumey  and  precision  stated  in 
terse  of  sU.iiard  deviation  and  raaxlmun  deviatl>n  over  one  year  measured  by 
toeclfied  wans.  All  supoortlng  faellltlee  for  new  electronic  eijulpnent  ahould 
be  cur-nased  concurrently,  including  test  equipnent  and  tools,  test  facilities, 
scare  carts,  oubllcetlcns  and  training  Mterlal.  Technical  naiatsnanee  publi¬ 
cations  should  t«  sxpsnled  by  supnlenental  Information}  tliey  should  be  written  " 
.ttfci^kslly  and  well-ill  uitrited  and  ahoold  covt'r  broad  principles  cf  function, 
nalnberAnce  and  operatiinal  use. 

The  Task  Group  reeosnenis  that  preventive  nalirtenanee  fct  limited  to  eom- 
pownts  and  parts  thiaf  obey  a  wear-out  law  of  failure,  as  idahtifled  by 
s'^clewRted  equipment  nanuals  prescribing  preventive  mainteuane*  periods  and.. 
proeW-orea. 

Whenever  it  is  econonically  ju3ti.<‘tabl«,  marginal  checking*  should  be  . 
esrlsved;  In  swh  cases,  the  equipment  nenufaeturer  should  be  requited  to 
furnish  testing  mrgins  and  te.atli)g  frequencies.  Marginal  checkirig  should 
bt  applied  to  transistorised  equ^mnt  and  analog  devices  as  -apidly  ad  research 
in  these  areas  pemita. 

The  Task  Croup's  study  of  iite  shortage  of  Sarviea  techr>lclana,  with-  pretoni 
eachasls  on  contract  technicians,  led  to  seveiel  recomendsMons.  Until '.this  . 
Service  8hi.^rUge  has  been  ramsdied,  consideration  should  be  given  to  nobillzitig  . 
cohTract  technicians  in  their  present  assigroient  in  an  appropriate  sUtur 
Imnsdiately  upon  dpclsratlun  of  a  state  of  emergency.  More  CKphasia  .chould  be 
.  placed  cn  utilising  Service  personnea  for  routL’w  maintenance,  and  all  possible. 

•  stess  sstft  *'e  taken  to. enhance  the  ciilltary  career  In  order  t«*  reduce  the  high 
turnervr  rat*  of  .Service  .tochniclans.  Because  the  long.trtifilr^  tisre  are 
rssultlns  in  the  inefficient  use  of  such  technical  ponjciwer,  tbr  Tasl  Croup 
recfjnc'^.t  that  the  Wl'itary  Uepartmentc  establish  Oirte  levsls  of  trainirtg,’. 
lies  ting  the  ruxl-nn  .tine  for  training  to  about  one.-U»:rd  of  the  tvaMlning 
tnlist.-**:ii.  The  .Ulltary  Tkipartnenfs  ahould .cond-.'-t  -i’nfWrrnees  and  8yn|>0i*lA 
tj  stimcinte  the  i:ttroEK^cil'''e  cxsnlnation  and  reappraisal  of  each  Service's 
.  training  effectl'.e.iess.  _  .  .  •  '  ' 


PART  If 


The  alnllirltlAa  end  dlfferenees  tf.f  the  Teak  Oroup  rettomendtUora  lndlce*« 
tiut  there  a  ^general  apreenentt  not  onljr  on  the  taslo  fhiloaot^  but  on  tba 
' definitions  used  by  the  Task  Croups. 

'  All  nine  Task  Groups  unlfonCy  Intorproted  the  quentlUMv*  reliability 
ruQulrRrKnts  which  appear  in  tlie  first  five  Task  Croup  asaiiTMuts  to  nean  the  ' 
namrlsal  pro’uiUillty  of  fallure-frco  syctea,  or  e>iiipnei(l.  operation  during  a 
(leacriitoo  time  interval  under  describhd  eoiujitiona  Of  perfonoat.ea  and  en7ijn<)i»et.t. 
Willie  the  rreeisc  definitions  used  by  Ta»k  G'.oupa  1,  3  and  B  differ  slightly  in 
.uoriiinvt  all  acknouledpe  ttiat  rellaMllty  is  a  probability  associated  with  a  tine  - 
interval.  In  addition,  all  the  Task  Croups  spree  that,  under  ueu.  l.eixctttstaneetii 
this  orobabiliuy -Is  calculable  fron  a  ainple  eKponentia).  function  involvtn|t  one  ■ 
variable,  the  duration  of  the  tine  interval,  and  one  constant  (reliability  tntox) 

.  varinu'ly  terrod  "neon  life"  or  "mean  tliee  between  fellure,*  or  e*ien  Inverted  end 
described  by  the  nunerlcal  reetpweal  as  "failure  rate."  Koat  ‘important  in  this 
<U>nsiderstlon  is  that  this  reliability  index  Is  a  ntswrleal  constant  that  describes'' 
the  probabilitv  sf  random  failure  and  usually  is  not  related  to  our  implied  ntining 
of  an  item' c  "life."  Task  Croup  3  notes  that,. in  all  eircuMstw^as. Mhm  tha 
staple  er--)ncntlal  function  does  not  yield. tha  correet  imtAbility,  the  enwr  In¬ 
in  .tne  8..fo  direction,  i.e.,-en  equipment  passlnp  the  prescribed  acceptanee.  tsstn  • 
iiay  be  t.ore  reliable  than  test  re.-fulta  indicate.  Furthermore,  the  cquiimien't  Mnu* 
faet«u«r  esn  take  step.a  to  enaure  the  validity  of  the  exponential  fbnitlon  to  ^ 
.minimise  his  risk,  .'  .  ■  .  '  '  . 

•'  *  »  »  *  •  »  *  . 

Adeordinply,  Ute  eciulptncnt  user's  desire  for  high  probebillty  of  »  failure-  ‘ 
free  miss. on  hss  Uen  translated  by  task  Croup  1  into  minimum  aeeeptatOle  value#' 
of  mesn  life  for  ttic  various  fquipent  categories,  and  the  tables  of  th^de  . 

*>»1  lability  indexes  set  a  nea.su.''able  lower  lli;it  t*  quantitative  j^llabllity .' 
that  .can  bo  v-sod  in  procurenent-  Tnese  tables'  can  be  extended  to  cover  ell  items 
not  already,  loculatcd,  Includinf  ono-rhot,  shortrlife  dericee  such  as  missiles, 

.os  wol)  as  none.iectronic -itens.  This  would  establish  a  lower  Itmi',  to  the 
rcll.ibllity  of  Uic  device  which  can  be  ussrt  fo.*  design,  aa  well  as  acceptance 
testinn,  even  wiien  teotlng  is  destructive.  , 

Task  Oi'jUf'S  2  .nni  3,  which 'were  e.ss'lpned  to  devise  teats  that  would  establish 
capability  and  conclusive  proof  of  mlnimun  acceptable  r(:ilal>ility,  hsve  prcaeribed 
testing  routines  to  demnstratc  that  the  reliability  indexes  of  Uie  tested  equip- 
^.onl  equal  or  oxceed  Uioao  nini.-nim  values  specified.  Aside  from  the  question  of 
the  degree  of  test  accuracy  or  cor.fldrnce  tnat  .-^ust  l«  achieved  'to  establish 
cacability  or  to  ritjjblish  concr.:',lve  iTtof,  the  foregoing  discussion  should  po.nt 
to  a  conclusion  thnt  tests  of  ninlnin  reliability  index  are  equivalent  to  tests 
of  iilninun  rellabll.'ty. 

Tusk  Croups  2  nnd  3  liare  chnsun  the  siune  kind  of  rnli.ahlllty  test,  siatistl- 
collv  t.’jr.cd  "trune.'it.cd  scq'aenti.ol  life  test"  tut  better  dejcriled  a.s  an  on-rating 
test  who-fe  duration  should  not  aifnificantly  sivorten  tSie  life  reruiinlnp  in  toe 
tested  ciiuip'ont.'  The  only  slight  dlfl'crence  Ir  the  te.sti'iR  ro-llr'S  of  the  two 
cri'oc.  Ihn.l  to-ts  io  that  a  doeision  should  reached  sooner  wito  the  Task  Group  2 
tost  th.in  i/’U.  th*  Task  "n/up  J  tost.  Tnls  difiVrvrcu  in  test  ''.u.-nllon  stens  from 
t.-.?  rcqij’.rrr..-:.t  to  catoMish  capability  in  the  fomer  case  and  to  establljl,  con- 
cl’-wU,  'roof  ir.  the  l-attor, 

»C 


Will*  tlMM  two  Oroup*  tveognlM  th*t  n«ui  8e|«nit«ly  aebtevt  •  a^undljr 
ehoMn  nintntei  teat  aecurecy,  boUi  eppreeiet*  the  coat  in  ‘  In?  and  muney  imnlved 
In  the  addltionaX  teaiiiV'  nni  nau  prcral'>nt  in  ^leetranle  equipment  procureneiit. 

Caeh  Teak  Group  Iiaa  made  a  judidsua  caAprouise  betmen  the  econany  of  abbreviated 
teatln^  and  the  accuracy  of  extended  tests. 

Tests  for  relisbllity  Index  (^ean  Ilfs,  ete.)  call  .  for  operating  aqulpnent  '- 
In  an  envlroincnt  roufihly  sluuL.tlng  the  conditions  of  Its  end  use.  Thus,  fron 
obsemtlon  of  failure  fi-equency  durint;  teat,  inference  Is  drawn  p«ge"dlng 
pnbabls  failure  frequency  during  '«actieal  use.  The  rules  for  treating  test  data 
are  e3taulist-.ed  by  forsalisod  statistical  saspling  tneory.  Fundanental  to  tbiS' 
appxoadi  is  the  ovlnclple  toat  xha  accuracy  of  decisions  based  on  such  tests  will 
lapi'o/e  as  the  q’^antlty  of  pertinent  data  (ms«ber  of  observed  failures)  increases. 

An  Increase  in  data  can  be  quickly  obtainad  only  by  tfctlng  largar  sanples  or  by 
testing  for  s  7.9nger  time.  To  keep  sight  of  the  llnltid  decision  eeeuracy 
available  free  tests  kept  within  .'easonwble  jugnitudes,  it  is  customary  to 
describe  such  tests  as  havlr.g  s  specific  eonfidetica  less  than  101  percent. 

How  is  a  requirement  for  conclusive  proof  related  to  an  'accuracy  or  confidence  ' 
less  than'  100  percent?  It  is  acknowledged  that  suA  etAte>«nts  as  "exantly  thrso 
.  feet*  or  "precisely  ten  piunds"  oust  be  trai^lated  litcreUy  as  rsq'.<Sring  sn 
•  iTifinlte  mnber  of  ciphers  following  the  decimal  point,  whereas  in  practice  there 
Is  usually  an  understanding  as  to  how  many  aig),!/ lca.it  figures  are  -important  'to  a 
'  dimension.  Accordingly,  we  interpret  "exact**  in  terns  of  a  practical  aoasurablc 
limit  of  accuracy,  losk  Group  3  has  interiireted  "conclusive  proof"  in  terms  of 
the  maximiai  accuracy  usually  exiiected  of  statistical. quality  control  as  apnliad 
to  electr'inie  equlfnent  procurertent,  Tas‘<  Group  2  interprets  "astablish  capability* 
aw  requiring  sotiewhat  lass  aecuraoy  than  "eoncl'uslve  proof  •* 

To  be  statistically  rigorous,  the  eonfidenee  that  can  ba  placed  in  a  deelsion 
or  conclusion  must  be  stated  ns  a  two-dlnenslo '.cl  parameter,  -For  instanM,  in 
respect  ';o  tbs  Task  Gruup  <  tost  of  davelopient  equipnent~-and,  in  a  hypothetical 
instance,  requiring  equipment  with  a  moan  time  between  fnllures  of  100  hours— 
there  Is  a  90-per<sont  probability  of  making  a  correct  deelsion  from  tiie  specified 
'  test  of  equipitnt  whose  trie  mean  time  between  failures  is  either  above  100  hours 
(to- accept/,  or  belisw  JO  hours  (to ‘reject).  In  ti»is  case,  the  first  confidence 
dlxcnsi'/n  is  the  >C-;*.rcont  probability  for  correct  decision,  and  the  second., 
di-ie.Tst-in  is  the  interval  of  uncfirtainty,  lOO  neers  to  50  hours,  e  ?tl  ratio 
In  mean  tin*'  between  failuros.  blmn  the  .*»arKs  hysot.netlcal.exan.ile  relating' to  «n 
lOO-i.oac  eqaipnent  is  applied  to  tpa  tlghbcr"  test  prescribed  by  Tisk  Oboup  3»  the 
statement  of  coiifideiice  becomes*  There  Is  a  ?0»perceiit  probability  of  midclng’a 
correct  decision  on  equipnont  vliose  true  mean  tine  between  failun's  is  eilJier  ■ 
above  100  hours  or  'oelow  67  hours,  .Here,  the  9C* -percent  probability  of  a  correct 
decision  is  related  to  a  1^:1  ratio  of  mean  t'tne  between  failures. 

In  vi.it  way,  if  any,  is  ti.e  equipment  user  penilised  by  any  lack  of  confidence 
in  Tash  Or>up  3  reliability  tests?  If  there  is  only  a  ?0-i.«rccrt  iTobabllity  that  . 
the  te-i*  will  reject  equlprert  whose  neen  tijme  twtweoh  failures  is  below  the 
te'_orablo  ni.ii.'itur.,  vliat  wj.U  b.c  the  'result  upon  tnu  'iscr  of  .an  equipment  that  should 
have  been  icjecUul  but  rviy  bo  accepted  as  x-cch  as  IC  percent'  of  the  'time?  Analysis 
of  ths  nechanisn  b.v  wMc/j  the  tests  operate  cniv;.  ti*t,  vhilt.  tncre  nay  be  as  such 
as  a  lO-.-ercer.t  pmhobi'iity  tlist  an  eqaifn.'nt  at  VA  spoctflcd  ninimum  nean  tine 
'cuiwesr.  f.-iiiurc5  will  to  accepted  r/ithcr  than  rtistted,  Uie  chance  cf  an  incorrect 
deii'/ion  to  .sccopt  r«d':cc8  '/er;.'  r.spldly  as  tf.e  a./m  tiro  tvtueen  failures  is  further 
laducoiJ.  Specif icail.'',  for  o  Ta.sn  Group  3  te-  .ed  taulfivT.f,  if  IJio  equifrant's  mean 
tiie  betv.-«‘e!i  f.iilures  is  exnctly  at  the  user’s  toicrnble  nlnlniis  (0,67  of  t.He 
contrafct-srv'cl/ied  p'uiiv.ir’),  otic  wr.inr  accertahic  deci!;l'>n  in  10  wlU  be  made, 
idwrasT,  if  ths  eq-.iip-'cr.t  is  25  rcrcerit  vorcc  t.".ar.  t:ic  tolerib'.e  nininin,  only  one 
wrong  dcci.'.lcn  in  50  will  t’C  •w  'o.  If  equ:;»-«-nt  exactly  at  the  user's  tclerar-le 
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rIw  0.90  Fi«3>«bllit/  of  Mlvtloik  aueMM  (as  1»  tgnr-lcal  for  Mny  Took  - 
r>roup  1  equipment  eatagorlre),  than  aquipMiit  i$  porcont  war**  than  this  lalnimn 
trill  gia«  O.P7  probability  of  oiasioB  attec«8a->not  a  sariotts  degradation  «btB 
rtevor  applicable  to  nora  than  otia  deelalon  la  50.  SlnUarlj'.  i«  trill  bo  fouttd 
that  the  effaet  of  llaltad  Mofldeneo  la  tha  tasta  of  Task  Group  2  on  tha  uaar 
is  ninor.  Furthamora.  tha  higher  tha  iataadeJ  probability  of  nlaslon  auecaaOj 
tha  anfillar  tt:e  affaet  of  Unitad  tost  eonftdanea. 

In  doaeloplnp  Ita  praaeribed  rollabtllty  tasting  routlno  for  eonponant  part*. 
Task  Oroup  5  treats  eonfidspoa  as  a  ttnidlasnsloital  "eonfidanea  factor.*  Carsfol 
analysis  shous  that  this  eonfideuca  factor  is  a  miterlcal  coaffleiant  which*  uhan 
used  as  a  nultlpller  fsr  tha  failure  rates  obtained  by  sltsple  calculation  fron 
abbreviai^d  test  data,  will  reduce  the  probability  of  fal}ure>free  operation  of  a 
cofiponent  by  a  safety  nargln  ubieh,  on  the  ererage.  is  sufficient  to  protoet 
against  the  inaccuracy  of  abirerlated  testlri);.  Thus,  in  this  ease,  the  need  for 
A  second  dinension  of  eonfidenoe  bas  been  obvieted  by  the  introduction  of  ayereglrt;. 
This  cpproacb  appeers  to  bt  uell-Jnstificd  for  application  to  eoRponent  parts, 
since  it  pemits  a  sirnil'lcant  red’icttoi  In  the  testing  requirencnto  there  they 
are  for  qualification  and  aeceptar.ee  nnitJne.  Hequirenents  for  testlrig  eonponant 
tarts  are  introduced'  as  a  tonvenlenee  to  iha  aquipnent  daslgner  and  nanufaeturer, 
and  they  in  nc.  vay  lessen  hlis  responsibility  to  denonstrate  adequate  equlpMnt 
reliability  through  the  testy  prescribad  by  Task  Groups  2  and 

Task  Group  1  has  converted  user  requireMnts  for  nlnisna  acceptable  reUa>  ' 
tllity  into  nunericol  requireaents  for  a  nlnitun-rellablllty  Index.  Tesk  OMup  J* 
describes  how  ar.  equipn«nt  rsliability  index  requlrenent  can  be  converted  Into 
naxleun  tolerable  .falltire  rates  for  neeh  of  the  ceopnent  parts  required  in  the 
eoulpnent,  or,  conversely,  how  the  equipnent  rsllsbillty  Index  can  be  predicted 
traen  thu  felluro  rates  for'  each  of  the  perto  .(as  applied  in-the  circuitry)  aso 
known.  Task  Group  5  describes  how  failum  rates,  of  parts  ear  he  measured.  Taak 
Group  2  sets  forth  neanr  for  Inproving  the  prediction  of  equi^stept  reliability 
index  (based  on  t'le  paper  design,  per  Task  Group  U  routine),  once  equipnent  n^ls  ■ 
iji'n  been  built  end  operated  in  tke'^  laboratory.  This  Group  also  outlines  ways  tw 
ascertain  that  the  operatirip  labrratory  nodel  neets  or  axccefn.  tha  nlnlew 
scecU.-sd  reliability  index.  Task  Group  3  prescribes  aathodr  top  datenslning  that 
the  rei  lability  index  equals  or  exceeds  the  specified  value  through  tiie  testing  of 
pllot-procuction  'anl  production  eqaitseent,  • 

Fran  the  ass  Ignaents  Of  Task  Groups  7,  C  and  9,  It  can  be  Infarred  that  thar*  ■ 
nay  soae  deteriorstion  of  rel  lability  Index  during  pecking  er.d  trensporUtioi^, 
storawand  field  rialntenanew.  Through  lupr»»re™ent»  In  taehnlques  of  theae 
cctivilies,  .satse  of  Uils  deterioration  can  be  prevented.  To  guard  against  remain- 
irr  deterioration  the  equl}r.pnt  aust  be  required  to  possess  a 'sufficient  surplus 
reliability  index  to  croure  a  rosidual  xlnbcuis  reliability  index  for  tactical  usa 
required  ly  ■‘da  user,  sS  deterslned  ty  Task  Group  1,  ' 

Task  Orouf  3  suggested  that  Task  Croup  1  nurters  .lo  raised  to  allxn;  for 
deteriorstion  «.<pected  as  a  result  of  field  nalntcnar.ce,  fiirt.her  raised  t* 
allow  for  deterioration  during  storage,  a»id  raised  a  third  tine  to  alJow  for 
dvtei  '.oration  during  transrortstion  and  hai.dllng.  Finally,  this  thrice-rsissd 
ii.-ure  shoUd  be  increared  by  50  percent  to  e.'»tatx..sh  the  contract  value  of 
rtllalllity  index  for  Task  Group  3  ril'*t-rro'}us’tlon/produrtl:n  tests  a?xJ  to  allow 
for  t.'.“  area  of  uncertainty  when  r.aking  teat  decision.-,  to  accept  or  reject. 
Fj-tendin?  this  .rhilosorhy  rur«har,  the  contract  fifrsre  'or  Task  Oro' ?  2 
-Jsvclojnent-riodel  taats  should  be  33  percent  greater  than  the  flpuro  for  pilot* 
rrsdu.:t,lon  tests,  because  of  the  greater  uncertainty  witii  tns  dsvelop^nt  test. 
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Aeeardtng  to  arallAtole  d«U>  Croop  P  kas  fetaA  that  rAltMUtgr  iletaiio* 
ntton  «ith  •iorA{,6  In  iiuiacnlTlnt;*'.*  Tank  7  tad  9  iwrt  Httfcln  t«  Identify 
dttarlorttion  la  mUabilitir  during  trtniipartatlon  and  tlwU  nalntantaea  In 
nrtcrietX  terns.  Angr  imowatra  for  autdi  deterioration  durlne  ttaaa  |tasea  aast  ta 
tased  on  entiaatea. 

.  It  appears  thr.t.  at  least,  laitlallyt  tlia  Inclusion  «f  eontraet  sv^traaents 
for  ttinisuR  reliab^ty  ittdex  will  so  reealLtionita  ib'e  aqulpnent  relii^illt/ 
observed  by  the  user  as  to  rvlerate  U>  caoo'dary  iaportanca  any  rUoHsnoa  for 
reliability  deteriotaiion.  'lotuettuently—and  ^so  lA  view,  of  galjis  la  eoatraetlac 
alspllclty— it  nay  be  aufflelent  at  first  for  eontractinf  aeenclaa  to  nafca  only 
•  the  single  eorrci.tlon  of  an  increase  by  50  peresnt  ir  translating  tha  amcrleal 
val’ies  frau  Task  Croup  1  tablca  to  Contrsct  requlrsAsnta. 

It  la  significant  that  aeverai  Task  Croups  soncur  la  sons  of  their  fladlada* 
not  only  on  t)w  usa  of  reliability  index  ae  a  yardetiek  (Teak  Oroupa  1,  i  and  I), 
on  relleblllty  testing  (Tss>.  Givups  2  end  1)  and  on  rallablll^  predlatlao  (T<^ 
Croups  2  ard  !t)>  but  In  tMny  other,  fttllusopblcel  aspeete  such  as  taat  aavironnent* 
tast^oata  handling  end  equifMnt-fellurs  enelyaia  (T.0.2,3).  tba  fact  that  no 
coenoR  sat  of  defin.*.t*of)S  ws  erployjd  by  all  vha  Croups  la  otdy  a  aatiar  of 
saeantlcs.  Tha  following  tanta  were  daf inad  by  two  or  sors  Task  Qrouna  as 
'  Indicatad: 


FsUura 

1,  2,  5 

.jtelUtlUty 

1»  3,  « 

Kellabillty  Indax 

1.  3  ; 

Bqulicnnt 

3,'k 

.  dyuteai 

3#  li 

Itibarent  •^liability 

3»  k  . 

itepalr  a'fort 
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PART  111 


Introduction 

■  To  prpTido  an  ovor-aU.  raview  of  tho  nln*  Task  Pzoup  stcdlM  ttm  tbs  point 
of  view  of  the  fancies  affected  by  the  rccoenendatlonij  this  saaaafy  is  divldod  ' 
into  sections  as  foUoutt 

(1)  lYocurer^rt  agency 

(2)  Csntnctor  •  •  * 

(3)  Oscr  • 

(b)  OcFMTtnent  of  Cafaase 


1*  Praecrenent  /.geney 

.  *  •  '  e 

1.1  Contracting  for  ^qulpsent.  .  .  .  ‘ 

,r.n  —  i-n  1  . 

Task  riioi.p  6  strongly  rseosaenCs  that  the  Interpretstioa  ei  ths  freed  Ssfrlces 
r-nacuryent  lierelatlons  be  staObJardlsed  aiiciic  all  tJia  Frocuriiig  Sswltts.  This 
Group  further  cresines  that,  piven  tbs  specification  requlrenasto  prspasad  by  Taik 
Groups  1  throueh  S«  the  oroeurenent  agency  can  aeecmplfsh  the  rdlssliigi  (1)  en> 
sure  inproetd  reliibillty  through  the  use  of.  eoet>type  or  rsdetemlcsbl*  eontnets 
during  tha  lt«ltl»l  production  run,  (2)  contract  for  extonslse  pUot-nn  tests 
prior  to  full  rr->duction,  (3)  carefully  select  highly  qualified  eontracters, . 

<b/  restrict  cxa?»tltlon  to  plAsuid  suppliers,  (3)  prorido  far  sesrsttcr*!  tests 
prior  to  aceeptai^e  and  (6)  prorl-Ja  for  esntirued  prsduct  laprseeseeS  based  on 
controlled  testing  and  field  experleneSt  . 

Tas'c  Group  2  reeoerends  that  proeurenent  of  elcetroole  eealjoant  'Aould  m>& 
telescope  dere..oac.er.t  sltli  .prototyre  or  rrodaction  procureaentj  fstfeer,  that  .. 
dellvrr}'  dates  should  be  established  so  as  to 'provide  for  orderly  devel^.acnt, 
followed  by  adequete  evaluation  of  reliability.  The  procureseni  agsacy  should 
■specify  to  whot  extent  bo  wishes  to  follow  the  recoRTendation  of  took  Croup  2 
that  the  contractor's  reilotlllty  progran  be  reviewed  and  supervised  by  an  lads* 
pendent  evaluation  rroup.  This  rscoRnendatlon  xay  be  node  applieehls  only  to 
that  rart  of  the  re  ilabtlltv  pro^vun,  as  specified  by  the  C/naip,  sr  it  nay  bo  ssds 
applicable  to  iM  eontrs.et.'r's  ertire  reliebUity  proerae..  ’  •  ' 

Task  Group  1  roconctebds  that  the  reliability  figures  ptoseetod  in  their  report 
be  adopted  as  a  basis  for  speeifyinr  the  rinir.vr;  acceptable  eqfuipeect  Man  Ilf*  for 
each  procurc>u>r.t  contract,  whether  rereorch,  developnont  or  prodKtiott. 

Tas'-c  Group  2  rao'ulres  the  cjoeurenLnt  agency  to  specify^  in  addition  to  the 
“ask  Group  1  r.iar.-life  reqairerier.t,  (1)  the  ninln-jn  perfornancs  cksraeteristles 
tc  be  r.onltored  d'-rirg  ine  ■lewlopr.ent-phnse  reliability  test,  (i)  tolerance 
Itoito  on  the  nerforrarce  specification  vtileh  can  be  used  to  define  a  failure 
d'arin,*  the  test,  (3)  the  nurior  of  devflopnrat  nodels  to  be  sis'^ltaecously  tertod 
and  (ii)  rertlneal  detaUo  of  the  test  erviionscnt  as  nay  oe  dictated  by  equipnent 
character isilcc  and,  nreferably,  of  such  a  nature  as  titat  suggested  by  fsek  Group  2, 


&  *  fubloDt  TmV  Gfrtup  3  rt^rcs  tbtt  cncunnent  mcrr-ey  to  apteify^ 

In  addition  to-U4(  wan-lli**  raqulnmer.t,  (1)  the  nir.iatf.  (jerforKanec  charaeier> 
iatlca  to  be  nonitoivd  i^anjig  the  I'iloVpnthxUon  and  prodcetlon  reliaUlity  teatOf 
(?)  tolerance  llnita  on  the  perromance  a|«ei/icatior.  attieh  define  a  failure  during 
theae  tests,  (3)  the  standard  enTimment  for  j-tlot-prsduetion  and  production 
rellfbilit/  tents,  chosen  fr:s  the  four  prorosed  standard  enviroiKenvs,  (Iii  tho  . 
twaber  of  flloV  r^nduclion  equlFnents  to  be  stsultaneov^ly  tected,  (J)  the  ri^btction 
rate*  ecplleable  u>  reduction  reliability  tests  and  (o)  election  of  a  requlreneni 
for  test  of  longevity. 

According  to  Task  Sroop  9,  the  Kiliiei:^  0epar>4rts  should  deteralne  the  . 
nlniim  number  of  pcrforsar.ee  Indexes  rsquired  for  eaen  class  or  tyre  of  equipnent  . 
or  syster,  in  otder  that  the  perfotaftnee  oi*  e  systen  or  equipmenv  nay  be  evaluated 
In  accordance  with  esubll^ed  standards^  The  Group  also  recSenends  that  purehasas 
of  all  supporting  facilities,  frr  new  rroduetion  eouipa^nt  ba  sr.de  ositcurrentljr, 
includlnr,  as  applicable,  test  equipnent  and  tools,  test  faeilltlea,  spare  parts 
for  both  rajor  equlpnent  and  teat  equipment,  adequate  p-^lientlons  feff  both  major 
equljwcr*-  snd  test  equipr.enl  and  prorision  for  tralritg"  material  fi  both  rujjor 
aquipnent  am*  test  equipr'eru.  The  Grout)  considers  inat  it  la  desirable  te  design  *  - 
Kc^uiar  units,  so  that,  -<1  tbe  cost  is  within  defined  lixiis,  t.tey  say  be  disperod 
of  rather  than  repul*'- 1.  For  this  reason,  the  post  limits  should  te  dof Ined  by 
eantract  or  specl'icatlon. 

Task  Orc'-p  2  .reccerenda  that  spare-parta  -froe-:renent  should"  use  equally  rigid 
specifications  and  requirements  for  reliability  testing  as  are  used  /or  the  pert*, 
'^cured  bX  tee  equi)aent  nanufacturer. 

1,2 .  ContractiiiT  for  Caeponent  Far^n, 

Tusk  Groi7  $*s  recorcaendatloa  is  that  the  present  go«erfcient  recilstlons  for . 
drafting  KUitary  .component  sjectfisations  be  amosdei,  if  these  speelfisations  • 
art  to  tstabiisii  the  requirqr.ents  for  reliability  bssed  on  fail'iSre^Kte  infonatlon. 

Also,  the  '•'roup  recorr'en.'s  thp.t  present  sreclflwtidns  for  corponent  parts 
te  Boclfled  t-wediately  th  assure  that  tte  reliablllly  inherent  in  tne  qualified  i 
product  is  piaintained,  and  these  modifications  be  ennsidered,  as  a  temporary 
'Measure  to  naintiin  tee  level  of  conporent  uniforsity  arid  to 'ensure  the  reteqtioM' 
of  whatever  ninirwt  level  of  quality  was  repteser.U.-i  by  the  origlnsl  q-.:alifleat{on 
samples.  *  On  a  rore  protracted  basis,  the  Tas'K  •Group-  recormendo  -the  r:evclapr.«nt  of 
new  specifications  conlai-ninp  (1)  statistically  desir'Kd'expefiJ’^hls  to  produce 
RiXlaua  lnforr.«tion  fro.’".  *.  r.lnimia'nw.btr  of  test  .sar-les  end  (?)  the'  proper  testa 
Ir.  sircle  and  rultiple  enriro.'r-er.ts ,  related  *o  the  comro.ient*s  end  use,  to . 
sjecify  the  failure  rat*  wi*Ji  relation'to  vatlo-as  derrees  of  test  severity,  Oae 
possible  end  econonlcvl  test  procedure  of  universal  ap'plleabilitjr  is  described  In 
detail, 

•  As  pari  •o'"  the  sonponent-part  q'iallflcstion  arproral,  a  s>/ficlently  large 
sanplk  s.oTrld  be  tested,  ir.  accoj-dance  vlt-.  toe  o’..tlincd  rroccdure,  to  estatlish  . 
the  rrinarj-fail'ae  rates  req-uired  by  the  speci^itatior  for  the  isr.vrtant 
parancters.  ,  If  Ju.itific-di  a  a',-rlier  "sho'Uld  then  te  ir-.-estipated  farther  with 
respect  to  h-’is  in-plart  e*.i»lil;.-  crr.Prrl,  or-irstinq  -usser  a  r/*w  proeevijre,  S-JCh 
intestiratiors-sho'aid  te  periodi-ca'iy  rejeated  anv,  at  the  sane  ti.-ie,  t.-»  recorda 
Strut ir-ired,  is-  order  baat  the  surplier  «>'  re:-jtn  q’ualifled^ 

t.te  q-rous  recjr..'»r.-is  that.  t.-i*. ."ervices  rcconcil*  tr.tir  diverrent  environ* 

Rental  rt-.-rircTtr.ts  and  ♦hat  th.oy  stale  a  sln.-Ie’set  of  ■;Koriirated  err'rorr.wital 
conditions  w-.irU  car  serve  as  U.i.'i&jis  for  lesti-u-  cor^one.nt  parts  to  cotatliah  ■ 
feilure’ rates  for  those  er^ironrerts,  yib-FTT-rCi  sni  :'l_-t»l  s.houid  te  «vi3ed. 


then*  to  prorltl*  toato  and  aawrttlaa  that  tnljr  aeasurt  eadpontnUparto  pac^  • 
fomanja  for  ttioa<.  arAlniRenta.  7ha  Task  Croup  haa  toen  a'trlacd  that  this  wfk. 
haa  b«an  atanrd  an  ad  hoe  rmiip  of  tha  Adviaoir  Croup  eit  Elaetrsnle  hrta*  - 


2.  gaula».ent  and  Cboponent-Parta  Contraetora 
2«1  EoulprKfct  Contractor^  '  ‘  | 

Task  Croup  li  reeoenenda  that,  upon  eodpleiion  of  the  atu^  antS  planning 
phase  of  aq'xlpaer.t  deveXoirteni,  the  eontraetor  shall  sutRlt  a  ranort  iaeludlaf 
(1)  calculatlona  and  data  aatiaatini;  the  uao  *allabilitf,  (2)  oaaa  of  natstoaoMd 
features,  (3J  caleclaUd  reliability  rsttuironento  for  all  pa^  and  eonponsatfs 
(L'j  reasons  for  any  antleipatod  failura  rataa  that  ara  lower  than  thaso  . . 

axp-erlancad  with  axiatlnc  cqulpnents  and  ($}.  raooRaeodations  for  ehancas  to  aflhdi 
£<t>Fllficatlon,  inpnaved  rallaiility,  lower  waifitt,  lass  space,  lowar  coat  aai  .  . 
shorter  schedule. 

A  detailed  procedure  la  set  forth  for  doUmlnine  inhorent  equipMnt  roll**  < 
blUty.  for  the  dasipn  and  constnetton  phase,  ths  Croup  re  -oantiidp  that  OWHIf  ,  /  ' 
effort,  shall  to  mda  to  (1)  select  siandattf  eirsttite  and  parte  ef  proved  reltMlSI^ 
and  known  failure  t«to,  {S}  Mleet  parte  and  eatorlals  frw  ftilitaty'prefenM.'  ' 
ar>d  standard-  parts  lists,  (3)  prepare  and  ssctae  approval  of  auitable  procumtaC 
information  when  requl><ed  failure  rates  art  not  suitably  deserifaod  by  wiettm  . 
nil  It  ary  sree.ficattons,  (It)  adopt  optlBua  eonstsvctlon  for  eeeonpliahiaf  fault' 
location,  rapid  repair,  f^turo  nodumisatian  and  logistie  supp^,  (5)  arracyt 
for  nareinal  tesiicy  id;ere  applicable,  (6)  desl^  for  optiauw  ^lli^,  (f)  eeltsKlir 
rrovldo  for  erpaeted  shock  and  vibration,  (6)  prptoet  asainsi  eoSaturai  .(93  ea»> 
aider  the  application  of  pa^  with  lOga^  for  tolaraneo,  stability,  anvinniwats^i-V' 
intoraction  end  er,d-af-ltfd  toleraaca  de^datlon,  (10'  •  'sider  to#  daratlnt 

parts,  -(U)  consider  printed  circuitry,  adtona'tle  aas  nepotltlto  oeduntasl'l; 

reris,  tee'iniques  for  proteetlns  parts  and  wlrlnp,  ano  provlda  a  cooplate  ^  . 

series  of  evaluotion  tests  to  assure  that  tha  aqulpaent  _u  west  operatioeal''.  ' 
r6quites:>*nts  with  tho  desired  raliafalllty  and  aalntala^lllty*  '  " 

Tes<  Croup  9  rucor-nen-ls  that,  wherever  feasible,  ioi  required  parfoieanoe . 
xisiev^s  be  included  in  the  equlpnent  specif leatiop  and  d*>ltn*C  into  the  e^paeat 
or  sj'sten  in  ths  sinplast  asnne.*.  Vhers.it  Is  topractleal  to  build  In-subehtciilitg' 
features,  prqviflons  should  be  node  for  easily  «eerislbl» test  points,  so  that  " 
these  aessurenents  can  'c«  easily  and  quickly  nada.  '  farther,  wltoln  the  cost  .  , 
Unite  -IS  defined  ty  contract,  disposable  aodular  units  rsqulriny  no  repair  MuMh 
be  enpljyed.  •  '  •  .  .  '  1=' 

Tbe  Oroup  also  resonnends  that  tJie  aqulpmnt  contractor  eonslder  potMtiai 
benefits  versus  addittorial  cost  for  ns/cinal  chsckiiyr  provisions,  and  vherever-it 
is  jmtif lahls,  that  he  p^vlde  'r-argln»  and  testir^  fre.quency  for  all  areas 
af  fee  tad. 


Task  Or;up  2  reconnends  a  reJl-b'Ulty  evaluation  for  develojMent  s-wdels 
corslst'xg  of  (1)  a  review  of  the  paver  design,  reliability  prediction,  operatlaf 
eordiUirs  for  all  rarts,  -arts  failure  rates,  perts-quallfication  test  statae 
ar,,l  .iesim  tolerances;  (Z)  a  failure-rote  test;  and  (3)  e  thorough  analysis  of' 
sil  failures  oncourtered  durinr  test,  Tha  ffitliirw-ratc  test  is  described  la 
do  tall,  and,  v'.th  nlnl-.-xi  near.-lli',,  perforrm-M  criteria,  tolerance  lir.lts,  test 
ei:vlnjs-.-.-::l  and  U.e  r.'Jitor  of  equlwita  fe."  slr.ultowous  test  are  to  be  specified 
by  contract.  Rules  for  Uat-a  h»!y!l!r4t  ar«  *»rjr.»rstei,  and  the -Group  requires  toai 
prew:  five  •wir.le.aonce  -iurin;:  test  'oe  prohibited  except  as  expressly  allr.^  by 
con  ract,  Tne  s--.'erv'.si.or.  ar.  i  approval  of  tne  rei’lablllty  effort  by  an  Independant 
n-/al-uatlof  fioup  are  reemended. 
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task  Oreu^  L  i«e»'rsnds  Uiat  a  rtperli  %s  ai  tte  slaw  af  dsssU^ 

neat}  settins  forth  (1)  ihs  preosdurM  fv  salaotisn  aid  aFfdlsattoB  ^  . 

aartSt  (2)  ciiwuit  i«dii>i:tust  niAiais;ne  affaota  »f  parts  a(li«»  ()>  ealndatSoas 
sf  pr^ietsd  s<(Ulpnr<!t  rsllabllit^,  {I'*  <ea(t:icmian  ftMR  to  r«dsadangr« 

{*':  •iaaerisn.ior.s  sf  ths  asMnhly  aacaarJoal  straeturBs  sslac&ad 

3Cii  aasufaeturinc  tad-.alques,  (6)  aral^sta  sf  stsl'-M^tsn  tssts  sa^,  (7)  iftfsniso 
ti:a  An  mUabilitj:  mikntavtn,  (f}  e»ditl;ai  cxpaeUd  to  efcai^  rsliahliitx  to 
cpsratibnal  ib«  mi  (9)  other  oKrents  Oi£  reoura^tions  hr  the  nassfaetuert* 

tsAk  uroiq>  y  raeoaneids  that  the  eeeipne&t  6si*W,  er  Idectlty  all  parts  aed 
esepcnents  •  itear^out  laWf  ape^iSyirf  tfi  the  e^uipaeRt  aactal  ths  tlso. 

period  Kii  pt>xe±.r»»  for  prsmtite  ulsteaanee. 

i  predlf  tloB  of  task  Citmp  3  is  that,  as  a  resist  of  ths  dasS^  rtvicv 
?ee».-wrd«d  or  of  failm  duriiie  teat,  oaoe  parts  nar  becaee  swpeet*  t^as  parts 
aoocld  be  piven  speelal  life  Mots  or  tsot  to  failtTs  to  snsars  that  sdequats 
osfetr  rer^ins  ex^^  ,  Such  s  serutirr  of  aldltisoal  parts  saf  offset  ths  spseial'* 
rtrUi  pnoureneBt  apeoifleationo  si^pestsd  ^  7a$k  -Iroup  ii» 

for  I'Uot-prodaetloii  and  picduotton  ersemae::t.  Task  Srosp  3  ssosneids  a  . 
S3r''3^f-;u7  ti'st  ertluotlm  of  ainiAtai  hillabllitr  tsdex.  Ths  sOBtraetor  foUiMS 
a  datallsd  proesdutr,  as  set  forth  le  its  tissX  report.  This  Qioup  also  fnMMa 
a  conplste  procedure  for  a  lohfierity  srslattioo,  to  be  iv^uirsd  at  tho  elicrottoa 
of  ths  eoRtraetinp  sceocf. 

task  Group  9  reeawnds  that  a  sai-.tainability  tsst  fcs  psifonsd  prt^  to  . 
rrleose  for  ^roductior.,  sith  ths  iapliration  that  ths  eslRtatiis'oilitj' fi{tx<s 
Merited  and  fie  oorflVnea  are  to  bs  ap?ror*d'bjr  ths  e«At*aetifi»  ijgmqr*  . 

'eti'-ls  are  proTidid  to  sUI  It  flaBrl:^  KSh  a  tsst. 

Toe  Iroap  also  reeMWoSs  that  this  »^ratioc.  Talus*  of  e(o<laetio»  st^SllsiSBi 
be  calculated  Attm  data  dsteni<ned  by  pretio^r*  test  aad  obasptatlott  !a  aeeordaaos 
eith  a  fstnula  prorided,  to  ho-vsed  as  ae  sves*>«ll  fijptre  of  writ  of-  ths  sqgttip*' 
aest  with' respect  to  fi^d  naistensncs  and  l»$istie  r.:rPort» 

This  Group  reccmends  that  saiatSBaRoc  puhlicatioRS  be  suppleaestsd  vith  -  • 
ore  sr  Rore  aianle,  ir/orral  and  well-illuelretad  hasdbooks,  coveric;  broad 
prlAcip>s  of  function,  niintsiunee  and  operetiov.  use.  Ixas;^  and  soerestioas 
•re  (Har.chooks  should  also  be  prorided  .'or  test  e^aipaer-t  that  Include  . 

C’.'R'.'.M  calibratios.inforr-atlon  baMc  o:  hstiosal  bureau  o^  dtazoiarda  standards* 
Accuracy  and  crecislor.  of  test  equipsent  ssould’  hs  atsted  in  two  sava— standard J 
<ievi*ti-»r.  and  aulnat  ceYiabioo  rter  one  year,  aaaaurri  by  selehtifid  Methods. }" 

Task  uToup  (!  rccaer.eods  the  desi^  of  amrlifted  standard  test  cq3tp!«rt  thst^ 
•a*r.  be  (i)  callbrited  1".  the  lieXd,  aair.f  iTaiiable  bails  star.dards,  and  .(2)  naiR* 
■U:r.<d  ir.  a  state  of  accuracj*  Uut  will  rsd-ee  rr^etlor.  and  acceptance  errors  as  ■ 
cucf.-  as  rosoible.'  it  cor.eXudes  that  the  de»i/s  of  aioiuate  t^t  equipRefit  has  • 
be<~.  tr-.-.Vd  as  a  seconiary  requiretsnt  eonstcerod  after-~noi  duri!^>>»the  dfsiin 
aAi  ".ir.ufacturw  of  the  electronle  equicher-te  tofttMlses. 

»lth  respect  to  t'-e  de«Spn  of  shipcir-r  containers.  Task  Group  7  recor.Tends 
V.e  =alrtcrar.<r*  of  c’rs#  vorkLne  relsti>:a  botsecjn  ha  cor.tAiner  dealer  md  tas 
erilRvrt  iiesijT.t7,  ar  veil  as  eiose  coUaioratiX!  with  t".e  pro.-s*ir.f  afe-.cy. 

Tr.-c  icouT  resewserds  <*>i’tija>'d  cn-f-hasic  ot  inrror‘-w  eoutainer  dasifr..  Taa 
.  s'-ecificutior.  for  tr.c  testir.ji  of  paeVei  eiestror^o  eo'.tpvfr.t  Uil  is  hemp  pna- 
r.-.rc-i  'Tj  "Jic  Pa;>!au  of  3~.i?s  and  the  Gffica  V.e  .tosi^tant  Secreta.;  x  Gefesse  • 
jRd  ioeistics^  shooli  be  eonrleted  tael  ipvvled  to  wlectronic  equirwet 
•■rorurcaor.l  prok.vss  *0  »«rlily  as  possiiie. 


Component  y>rt«  Cftwtr«ciar« 

T«sk  Cr>up  S  neonmnda  (1)  inentMi  aaphaaSs  an  titt  hm  0f  teimnd 
•l»etranie  eoeponcnta  *ni -naUrlala  and  (2)  a  propran  tvt  predict  Iwprowawt.o 
a  piuM  of  tha  parta  plai. 


3.  Caar 

3  X  y.aiBtanan<ia« 

To  provloo  a  aaxlam  of  <tiU  nanssafjr  fo*  roliabUlty  atudlaa,  i*ksk  Ctwip  8  . 
recocrterJa  that  teat  and  inspection  r^quimtenta  bo  rovicK^  and  anondada  Tha 
Gro'jp  reftmenda  a  reriew  of  tne  appasentljr  wldaapiaad  philosophy  that  adaaaato 
and  valid  testing  and  reportinr  at«  not  tiilitary  f takctiMiS’ of  {viaary  iafiortanca« 
even  during  peaeatlne.  It  is  believed  that  thara  is  a  basic  of  vndcrstandiOK 
,  en  the  part  of  r-anacenent  eoneemini;  tha  need  for  tha  apeclfie  data  required  for 
reliabrliiy  studies,  deeordinply,  tha  Sr»iq>  reeottnends  that  rarortinq  orocadurao 
be  revisad  to  supcly  these  data  in  a  fom  peroittin^  consistent  reduction  and  . 
analysis.  Ill  depota  and  aiailar  oryaniaationa  ^uld  be  required  iaeedietOLy  io 
start  keep'v  a  record  of  all  eottipoents  teated  on  reeertif  ication  stid  other 
testlnc  and  inspection  rtaqranat  details  to  be  recorded  ere  aii»tratad.-  Snffieiaot  ' 
BuUitrl^-y  should  be  tested  in  quality.eontit>l  orssniaattona  in  ell  brenebaa  of 
tha  Services  and  in  industiy  to  assurr  the  polieins  of  the  forotdtos  recoenendetloov 

Task  Cmnp  9  nex-tenia  Uiat  ^  perfonaanco  stendatd  of  each  eqoipnsnt  oddaX  ' 
.be  used  to  detemlne  whether  the  eqwiinent  la  operatlnf  satlsfeetorily  after  eogr 
sr.intenence  activity’ and  thatT  the  perfonaanee  standards  be  adequate  to  pemlt  this 
function.  Cperators  and  naintananee  teihnielans  shotald  be  trained  to’  reco9>lao 
and  use  all  inTorantion  derived  froo  testa  against  these  eerfemanee  standards. 

This  Oroup  also  neoinends  that  preventive  Mtntenanoe' be  Iteited  to  Itano 
tisat  cbey  a  vear-out  law  of  failure  and  that  such  ttens  be'  lefannced  in  tho 
equlpeent  aanusl.  with  the  desired  oaintenance  frequaney  specified. . 

Tha  Croup  reeoRcends  that  test-equipnent  ealibretlon  eentero  be  eetebliahod  * 
at  various  losotlons  to  supr.leoent  existing  facilitlae  and  that  tbay  aepSoy 
standanic  re^cUarly  conpared  with  those  eveilable  at  thn  Ketional  Pvtae  of 
fiardardt.  ’ 

?.  -  •  Storage.  '  ■  .  ‘  . 

Task  Ojout  P  nooTnends  thot  every  atUupt  br  node  tc  record  the  life  hUtory  . 
of  I'tiivid  :3l  units  of  electronic  aquipnent  prtor  to  their  plseenent  in  etorafe 
so  that  nare  can  bo  learned  about-  the  afreet  of  storage  on  reliability.' 


li.  Ptparbr.VnV  of  Sofense 

i.X  gtreetives/Inctructions, 

Task  Oro-jp  9  recomends  that  the  IVipartnent  of  befense  exTsaitd  tiie  aaintalna> 
bility  jestion  .of  Directive  jZc2»l^  to  roq-uire  oc.TCurror.t  pureheso  of  alt  sappoxt' 
irg  facilltips  far  "new  prcductHn  equiprcrit.  Suppertlng  facilities  includet 
Ust  equipv‘flt  und  tcolSf  test  fsc'ilties,  spt/e  parts,  adequate  putlleations  and 
prsTislau/or  trair.lr^;  aaterial.  ’ 


^■'Arpraval  sf  Kcw'EqaJrnent  ’.nd  .'jyjter;  far  Terrlce  b’se,"  5  July  1956. 
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Hm  Citottp  matTMiids  ttet  tuviwitiw  mIbUmim*  t«  n^tUmd  in  DOD  Straetl** 
m:  TOionkt 

Pnmitiw  Mintenmct  ia  a  practAu*  of  inofaetinp,  totting  and 
reeendltionlnc  a  imduct  at  rccuiar  listorAl^  and  aceordinc  to  aptcifia 
imtntetiom  ia  ordar  to  ;3««*nt  failtma  in  aarrica  and  to  f«tai>t 
daUrloratloiu 

Taak  Group  9  aUtaa* 

To  rcdw*  ttio  hiiii  t«rr<««er  nt«  at  toeimlelaoa  in  tho  Sorvleo,  nor* 
offort  and  ORphaaia  ^ou3d  be  ta  ulUixaiioii  of  Service  peraonnaX 
for  routine  daintonanea,  Mith  oorreopondlnKljr  dbtiniohed  eephasia  on  ■ 

'  eoRtneb  technicians  for  this  reijoiment;  all  possible  stops  nnst  ba 
taken  to  enhaneo  the  nlliterjr  career  fay  repreaenting  to  Con^reoa  tbo 
edierss  offeeta.of  financial  and  fringe  benefit  lialiatisne  on  tho 
lOBg.tena  offlelency  of  the  Servicee* 

Beoaiaa.  of  the  loaf  trainittg  tiae  for  te^leiaes  le  resulting  In  an  inafflaiaoi 
ntaliaation  of  nanpower*  tho  Group  iWciMeads  that  tho  Military  Scpartaonio  aotab* 
Xiah  three  lasela  of  training*  oe4o*di9g  to  dstaUod  aocfeationa*  that  they  lintt  ■ 
tha  mxSam  trainii^  tine-  to  aptrcxisaUly  one^tbird  of  tho  reealhing  Onlietnent 
ond  that  the  AcnartMent  of  Osfdnsa  .eondnet  eonforaneea  and.a:a>pceia  to  atisiUeto 
and  xeoppralao  Rilitaxy  training  cffectiMnaaa. 

Task  Group  (  reeopnlxoa  that  eoeaidarablo  firld>taai  and  failure  data  are  * 
available,  bnt  this  ImoRcation  taast  be  Xaeorlously  eonverted  to  a  standaril  fora  -. 
that  lends  itself  to  statistical  and  onglnseriaf  enalysia  before  it  can  bo  - ' 
properly  processed  and  erjJyzed.  It  is  ija:lled  that  an  inproutd  atondard  fOraat 
is  needed  to  ease  the  esseesnent  of  srudi  data* 

ti*?  Speetel  rrajeete*  _  .*  •  .  '  .  ' 

Task  Croup  1  requests  tMt  the  appendixes  to  its  final  *'trort  bo  rovlewod  to 
dotesnlne  tdiCthe.r  tho  nnderljriM;  ass*aiptions  ore  consistent  vith  the  aprlloation 
in  question*  Special  studies  are  reoansenlad  to  establish  reliability  require* ' 
eents  for  the  n^or  air  defense  data<<.andlirx  systans*  sutii  as  SAvf*  I'sval  laetieaX 
Asia  Sysien  and  Kissile  Xastur  and  for  nissilebonsv  electronic  equipsent* 

The  procuring  Sereices  are  asked  to  rcvicv  and  como^  on  *aA  Group  3‘'a  tost 
reconnendatioM,  taiUi  rcs'eet  to  a  trial  Uiplenentation  on  aeverai  seloeted  don* 
tracts  and  oundatory  inolenentatibn  in  all  electronic  pbocurenent.  Tne  Group 
also  asks  that  a  linitod  sroun  of  nilob-produevion  contracts  bs  salactod  fnoa  e 
variety*  of  prscurinr  Services  and  contra  ;tora  and  tint  conplianee  uith  too 
recowvr.dea*.  reliability  test  rethod  for  evalLstinp  pilot-pnoAoction  aqUipnent  be 
aada  aandatory  upon  ther.  It  further  acks  that  s  lintted  group  of  rnoduetioo-  . . 
cont.ucts  bt  sinUarly  chosen  vithbst  regard  l&  ahetiuT  nllot-produetion' versions 
of  that  oquipent  h.«ve  been  evaluated.  In  addition,'  it  urges  that  a  portion 
the  producti’en  contracts  he  sutJeeW!  to  tne  lonrevity  evaiastion  procedure.  Ihe 
lepartnor.t  of  Defense  is  asked  to  review  tho  test  eiactior^  of  the  contieetiAg 
agoricies  and,  pericoxeally,  lie  progress  of  the  contractors. 

Task  Group  7  resoteKods  sjat  a  review  of  all  rulao,  reguXatior.s  and  tariffs 
involving  bJxkirg  and  bracing  of  shiprlr^  containers  during  transit  be. 'lade, 
with  the  objective  of  tufvovinp  and  enforcitet  th'jse  requirenents. 


^'Departnert  or  Defense  Kalnteuance  Sr^iicCring  rrorra.-.,"  )  Soceaber  l?5fi. 


TMk  OMup  f  tveonnnda  tJMi  a  irogna  of  analysis  tha  f.*.tld~ta8i  and 
fall  M  «*ita  nov  on  f Ua  ba  inltia'tad  at  an  aarljr  data  to  eapitallna  on  tte 
avallabla  iriTun^MUen  ao  that  aourera  of  dafaetlvanaaa  na/  ba  dirtivara^  and 
oorraeti\«  action  vikan.  It  furthar  raesajianda  that  a  oentnllao  axpariaant 
itiYolrine  aioraca  and  tast  of  a  atattatleallj*  al^ifleant  oanpla  of  typical  a^ulp* 
jicnta  b#  eonalderad,  *,  .  .  . 

.  Task  nroup  9  auegeats  that  tha  Capartnant  of  Dafcnsa  astabliah  ipiida  llnca 
for  a  st'id}^  evalucU  an  abaoluta'  atarapa  tachnlelan*  It  urfes  tha'l  eonsidar** 
atlon  ba  plven  to  mobiliting  contraot  technical  parsonncl  In  tholr  current  field 
assl^^  nts^  ir  an  arpropriata  atattta>  Isnediaialy  upon  daelaratlon  of  a  state  of  . 
aoerRaney. 

This  Group  raecenands  that  prcsant  inrestiratlons  In  narclnal  eheekti^  for 
transistorlisad  equtinant  be  continued  and  that  researob  of  lucglnaX  ehaoklng  as 
applied  to  analog  darlcrs  ba  axtandad* 

To  alleulaia  the  tnereoslt^  shortage  of  engineering  peraonnel|  Taste  Group  9 
augpeste  that  tho  .Oapartsent  of  Sofense  should  raeonoond  to  tho  aooroprlata 
reiaral  aponey  and  .to  the  National  Cenmittea  for  the  Davalopmnt  Of  Selantlats 
and  Krv,ir«ers  tJist  enphasls  on  subjaeta  aueh  as  nathamatiost  physics  and  rinisStity 
be  Increased  at  the  saesndary«se:iool  laeel*  An  Immstigation  should  ba  nada  into,, 
the  payeholapical  reasons  responsible  for  the  antipathy  Of  the  tesn^aga  populatm 
toward  anpinecrinp  scianeest  and,  fron  this,  $ffactl«^.  aeons  lor  eounVring  this 
feeling  .should  be  derlsed, 

tt,3  t?ew  Star.dlmr  Conolttoes.  -  ‘ 

Task  Group  9  recomends  thst  a  eentrallted  working  group  ba  astablishad  on 
a ‘contlnuinr.  basis  y  1th in  the  Departnent  of  tefensa  to  coordinate  and  arklaata  ' 
reliability  data  froa.ell  sources  and  to  report  reiailarly  on  the. results  of  these 
araluatlohs,  .  .  ••  • 

Task  Group  9  reao.-im'jnds  that  the  Department  of  Sofanao  'astabllsh  a  group  to  .. 
jnohltor  the  onerstion  of  tesWttnlfMcnt  eaiitrstisn, centers..  The  group  «rouU  ■' 
ascertain  the  nuwter  of  iseasurcncnts  "aade  on  specified  pera.-neters,  develop  s 
rnifnn  ensuring  that  all  field  dalitration  activities  properly  swlntaln  high  . 
standards  of  acev.-acy' and  precision  and  specify  the  sssisUnoe.  required  froa 
'iational.Sureau  of  Standards,  ..  ’ 

Tas!t.  Group  1  meomends  that,  as  tl-s*.  and  effort  for  atud/-  are  available,  the 
n'rierleal  riean-llfe' values  tabulated  be  reviewed  with  respect  to  nodif ieatlon .for 
V.st  enviromf'ht,  state  of  the  art,  cooproniac  with  oUjer  perfomance  ceatwres, 
tost,  .Talnten'.nee  load  .and  availability,  ' 

Task  Group  S  recofwi'rr.ls  thst  the  devnlocraent  of  parts  speeifieatfons,  th# 
testinr  of  parts  for  design  capc.bility  and  the  ievelopnent  of  iivpocti.on  nethods 
be  Intaijj'otcd  and  coor’lnaled  by  e  gr;up  at  i>«pcrV!er!t  of  Defense  level.  The  • 
po-.p  -should  insludo  reur^sentativps  froe  tpduotry  end  the  sillitary,  and  it  should 
inci/de  personnel  fro.i'rcsoa/-cr  and  dove.’u>ptv.'.nt,  etandardlz.ntlcn,  *procura.*.ertt  and 
qa-ilUy-asjuranee  functions.  An  adequate  suotiy  of  oonpower  and  a  budget  to 
orcMte  a  c.iordlnated  systeo  rmst  be  pro'/ided,  Tils  group  should  review  all 
existing  roliabxMty  rroprafl-o  and  orojeets  for  coorlination  and  avoidance  of  dupli 
c-ition,  dewinlmtion  of  further  work  .and  ider.t' ficali.on  of  needed  oontraotsj  it 
should  estabiljh  srocoduron  and  methods  for  diss«'.irating  infoi~vatlon  gained  and 
ec'.ablish  a  bisls  for  an  application-notes  cublication  separate  fron  the  sr/ecifica 
tion.s. 
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and  tBllitary  cbaraaierlatlea  and  in  aubaaqoent  profniranaki  daeiaiantc 
Suitably  adapted^  tha/  nay  ba  dlraetlj  applieabla  to  uany  casaa.  InJ 
gftneral,  thaae  flguraa  ahould  ba  eonaldarad  aa  flrat  approxlaatlonO  | 
to  Dora  durabla  reliabllltgr  ataindarda  vhleh«  it  ia  bopad,  vill  ba  ; 
evolved  ati  a  raault  of  tha  actual  pvaet'iea  of  apacifleation  ef  ■ 
reliability  by  tha  amed  aarvlcoa.  ’ 
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1  rtroOPPCTIOM 


1.1  Taak  Aaslgnagnt 

Task  Number  One.  eselgned  by  AORBB  le  m'  followst 

"Develop  mlnlm'tm  acceptability  figures  for  reliability 
of  the  various  types  of  military  eleetrcnle  ec->lpnent. 

These  figures  possibly  tuty  be  evfrsssetf  as  'time  between 
failures'  or  some  other  truly  quantitative  ueaeureaent. 

The  basis  upon  which  the  figures  are  determined  shall 
Include  the  factors  of  operational  mission  requlreMnts« 
maintenance,  complexity,  and  such  other  factors  as  may 
be  significant.” 

Task  Group  Number  One  has.  completed  Its  Irvestlgatlon  Into  thlg 
task  and  submits  Its  report  herewith.  The  results  are  presented  Is 
Section  4.  The  general  approach  and  various  quallfleetlons  arc  dls* 
cussed  In  the  body  of  the  report  with  further  details  In  the  appen*- 
dices. 

Importenee  cf  Specifying  RelieblH-vy~~ 

The  problem  of  achieving  and  Mintaihlng  adequate  reliability'  - 
in  military. electronic  equipment  is  Is^ortant,  complex,  and  dlffl> 
cult.  The  solution  to  the  problem  Is  Inextricably  bound  up  with  ths 
healtnj-'devsiopment  of  future  elsctrunics. 

Significant  tn  the  AGREE  proiicrsm  of  nine  teske  are  (s)  the 
quantitative  approach  to  the  problem,  and  (b)  the  recognition  that 
reliability  must  be  bought  sa  are  other  aspects  of  quality.  The 
present  ominous  reliability laltustlon  arises  In  part  from  the  lack 
of  quantitative  specification  of  equipment  rellsblllty  prior  to  de» 
velopmcnt.  Such  specifications  are  fundamental  to  quantitative 
treatme.nt  of  the  problem— a  specification  Is  usually  considered  as 
a  detailed  descrlptio.n  of  s .product  and  Its  performance  and  of  the 
criteria  which  must  be  used  to  determine  hbether  the  product  is  In 
conforalty  wlfh  t.he  description. 


In  th«  p«st«  &  BMiufneturtr.  encngtd  in  tht  tftaign  of  a  n«w  nyatM 
hns  been  confronted  with  the'  neeeeeltjr  of  Meeting  .eertolo  perforoenee 
requlrenente.  Theoretically*  he  haa  been  equally  reaponalble  for  aaaur« 
Ing  a  high  level  of  roliablllty  In  the  new  ayatOM.  However,  In  eon* 
treat,  the  perforBanee  requireaenta  have  been  eabodled  In  apeelflea- 
tiona  in  quantitative  teraa,  and  the  manufacturer  had  a  leaal  obllga* 
tion  to  meet  then. .  Conaequently,  reliability  haa  generally  been 
treated  ea  ati  afterthought,  l.e.,  after  a  dealgn  haa  attained  other  per* 
formanee  requirenenta  which  are  rigidly  apeclfied,  reliability  la  then 
conaidered.  Experience  liaa  shown  that  thla  la  too  late  »  the  dealgn 
of  .in  electronic  equlpneat  areatvs  in  Irreducible  failure  rate  which 
cannot  be  debugged  froa  the  flnlaned  aachlne,- 

Reliability  -requirenenta  should  originate  with  the  groupa  .rcapon*' 
aible  for  the  operational  requirenenta  and  Military  characterla^ea  of 
the  various  services,  since  It  la -through  these,  groiqia  that  the  aervloea 
nust' deternine  how  they  .Intend' to  aeconpllah  their  nlaaion.  Xn  turn, 
these  figures  should  ba  translated  Into  eontracta  let  for  the  new  de*' 
velopmenta.  This  should  ba'  done  in  a  why  which  effectively  notlvatea 

•  *  *  *  ’  V 

dealgn'era  and  provides  a  reasonably  clear  baaia  for  aubadquent  deelslona 

Hand  In  Hand  with  c'ne  practice  of  apec'ifylng  reliability,  there  la. 
an  additional  definite  need  for  ptrallel  progress  In  the  testing  and  pre 
diction  areas.  These  and  rented  problems  ar-»  being  pursued  by  the 
other  AGREE  T«sk  GroMps. 

■  2  PEFIMITlOWy 

2.1  Oenerel  Definitions 

The  followiijg  definitions  are  taken  froa  general  reliability  theory; 

(a)  Falluret  the  Inability  of  an  equipment  to  perfona  its  re* 
quired  function. 

(b)  .Hellftbilltyt  the  probability  of  no  failure  throughout  a 
proscribed  operating  period. 

(c)  Keen  lire;  the  arltheoctlral  mean  (average: of  the  operating 
tine  between  fal3-u*os. 


• ;  r 


i 

-4.- 


-  '  (d)  Pp-tlitt  th»  eftlAiMUp  tlM  In  vhieh  th«  syatni  1»  eon«id*r«tf 

'  In  eondltlon  tc  parfdm  Ita  required  function. 

M  l?ovn-ti»aei  the  calender  tine  in  vhlch  the  ejetea  la  not  con* 
eldercd  in  condition  tc  perfora  its  required  function. 

(f)  Repair  effort;  the  nuaber  of  aanohoure  actually  apent  on 
.  repairing  a  failure, 

2,2  Klniaua  Acceptable  Rallabilltr 

There  are  at  leaat  three  poasible  awaninge  of  the  vorda  "aiiniBUia 
acceptability"  vhlcb  appear  in  the  etateoent  of  Taalc  Mo.  1:  (a)  that 

value  vhlch  the  operational  eoasBander  will  tolerate  .and  belov  which  he 
would  take  aoc  -draatlc  action  to  initiate  iBprovdaienta;  (h)  that  value 
vhlch  agrcea  with  the. current  reliability  values  observed  for  each . 
elaas  of  e.^p-aer.t;  and  (e)  that  value  which  the  current  etate>of»the-r 
•art  and  current  trovledge  could  aebieva.  ..  •  .  . 

All  three  of  these  possible  neaninga  are  quite  ganaraland  rather 
vague,  .and  all  thrae  suffer  team  the  fact  thdt’jpresent  values  and  ’ 
prpsSnt  etate>ofothe>art  are.  hy  and  large,  unknom  quantities.  At 
present,  the  only  basis  for  deteraining  these  values  is  by  rough  estl> 
Bates  Or  -guesses.  *  Nevertheless,  in  order  to  aeeoopllsh  thb  Task  Qroup 
aisslon.  it  is  necessary  that  voee  definite  cohelusi.ons  be  reached  in. 
regard  to  the  neanlng  of  the  words  "tiinitnum  acceptability^”  The' Task 
(h’oup  hss  adopted  the  first  definition  as  being  closest  to  the  intent  . 
of  AGKl^S.. 

.2.3  Ih'^ex  of  Reliability 

Field  oeaetireaerts  of  military  and  cotsaerclal  electronic  syatcas 
have  deBonstrated  that  in  general  the  rate  of  system  failure  is  fairly 
constant  throsghont  t.he  life  of  the  system.  Therefore,  the  probability 
of  non-falltu*e  over  an  ope  rating- time  Interval  decreates  exponentially 
as  a  fu."’.ctlo:>  of  the  length  of  the  '^ntervel,-  l.e.,  . 

H{t)  =  e-t/«. 
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where  R(t)  l»  the  reliability  (probability  of  no  falluraa  in  operating 
tine  t  houra)  and  n  la  the  naan  Ufa  or  naan  tine  between  ayaten  failuree. 
Additional  'diaouaalon  of  thla  particular  fomilatlon  la  given  in  AppMi* 


If  the  reliability  of  eleetronle  ayatena  can  be.  expreaaed  aa'a 
Blnple  expcnentlal  function  of  tine,  the  reliability  of  two  ayatena  then 
can  be  eoapared  according  to  their  nean  Uvea,  alnce  the  naan  Ufa  la  the 
only  parasete**  In  the  reliability  functlona.  In  thla  report,  reliability 
will  be  chax-Bcterieed  by  seen  life.  By  apeelfylng  a  nean  life.  It  la 
poBBlble  to  develop  varloua  typea  of  teata  to  aaaure  tha  nlnlaum  accep¬ 
table  reliability  under  operational  uaaga.  Under  tha. exponential  aaaunp-  ■ 
tlon,  c.]y  reliability  atatenent  .for  an  eleetronle  ayaten  can  be  con¬ 
verted  Into  an  equivalent  atatenent  about  the  nean  life  anid  vice  veraa. 

■2. A  Operatloncl  Readlneaa 

If  "operatior  x  readlneaa*  la  defined  aa  th«.  probability  that  a 
ayaten. will  perxom  satlafaetorlly  at  any  point  in  calendar  tine,  .then 
the  percen.ttge  of  "up-cl»e*  la  ayoonynoua  w*th  operational  ^adlneaa;  ' 

For  electronic  ayatena  ihcre.(a}  the  critical  operatlng»tlBe  perloda 
ere  of  indefinite  le.*Vib»  (-)  la  available  Iraedlately  after 

failure  and.  In  nany  casea,  {c}  redundancy  of  a/stena  exlat,  a  specified  . 
probability  of  a  given  nunber  of  houra  of  fault-free  operation’ la  not 
adequate  for  eonpleta  speclfloation  In  regard  to  the  operational  needs. 
Although  a  systen  nay  fall  frequently,  if  It  can  be  restored  to  aatls- 
factory  operating  condition  in  a  short  tine,  this  ayaten  can  be  of  tre¬ 
mendous  value  under  certain  operational  requlreeenta.  Therefore,  the 
readlncBB  cf  the  systen,  l.e.,  the  percentage  of  up~tlne,  la  a  critical  - 
factor  to  consider  In  such  eases.  It  la  clear  Inat  this  operational 
readiness  depends  upon  both  the  reliability  of  the  system  and  the  speed 
With  which  It  '^an  be  restored  after  failure. 
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2.5  I«poPtw»cg  yotor 

Xt  not  oooy  ofoa  for  ozixrtMftod  porionaol  to  ■poelfjr  •  niniiw 
•oe^Ublo  rollobtllty  for  «  partloulor  oloetronlo  otulfint.  .Roll* 
ability  generally  It  Moolngful  only  fron  tho  •Uadpolat  of  nliolon  . 
sueeeso.  Many-oporatloMl' pooplo  om  oognlzant  only  of  tho  Biooion 
sueeeto,  ohleh  entollo  the'  rollabillty  of  not  only  tho  oioetronie  ayatoB 
of  -  intoreat  but  alao  of  a  eonbat  imlt,  waapona  oyataM/  or  ortaniaationol 
unit.  In  order  to  detemlne  the  reliability  rodulred  for  the  eXeetrbnld 
ayatea,  one  uy  detemlne  tho  reliability  required  for  tho  coahat  unit 

then  deteraine  an  laportanee  factor  for  the  oioetronie  ayatoa  of 
'Internet-.  The  laportanee  factor  of  an  cqulpaent.^lo  the  relative  Itoiwfo 
tanee  of  the  particular  electronic  a^stea  to  tho  total'  alsslon  offoe«^‘ 
tl'Vencsa.  Thla  le  defined  in  thla  report  aa  the  ratio,  of  the  nuabor  of 
Biealon  fa'llurea  duo  to  the  equlpaient  falling  to  the  total  nuaber  of 
failures  of  the  equlpeent  (eec  Appendix  0).  .  ^  . 

2.6  Modulea  . 

A  concent  of  module  la  uaed  In  this  report  for  three  purpoeen;  {a) 
'80  that  the  relative  complexity  Inherently  required  can  be  taken  Into 
account;  (b)  eo  that  the  alnlaua  acceptable  reliability  figures  will  not 
be  grossly  inconalatent  laong  tha  aervlcaa;  and  (e)  ao  that  rellsblllty 
requlreaents  will  be  dynaalc^  and  state>or>art  changaa  can  be  Incor- 
rorated  aa  they  occur. 

-  Thle  Bodule  concept  vlll  be  the  beelc  eleetronlc  building  block.  . 
A  •nodule*  will  be  a  group  of  electronic  porta.  Thla  la  s  fietlUoua 
way  of  partitioning  an  alectronlc  ayaUa  for  reliability  purpoaaa. 

For  ayateaa  Involving  elaetron  tubaa,  it  has  been  found  that  for  ona 
tube  there  are  approximately  fifteen  additional  electronic  parta«> 
thla  ve  co.=’pio».r  to  be  a  moduJe.  Thue,  tne  number  of  modules  for  an 
equipjwr.t  la  defined  ae  tne  number  of  electibn  tubea.  Account  of 
solid  state  electronic  coRponenta  la  caxen  In  Appendix  B. 
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■3.1  S«l>etivlty  1ft  Seoy 

It  «a»  tfaairtd  to  coy^  tito  oroM  ttboro  roIlAbility  it  M  acttto 
pirableo  in.  a  fairly  oooprchonolve  Moner  and  stl'll  ba  ^ta  apaelfia. 
Tha  acopa  of  Taak  Huabar  O&a  la  unfortunataly  la?ga,  both  froti  tha 
atandpolnt  of  tha  nuabar  of  aqulpMata  InaolTad  aad  for  tha  eoaplaslty ' 
of  tha'anaiysio  t^quirao  for  a  thorotifh  study.  Tharafora,  It  mo' 
neeeaaary  to  adopt  abort»cut  aathod*.  uaapoaa^ayataaa,  eo»> 

bat  unlta  or  orcanlaatlona  »ara  aialaetad;  and,  ahararar  poaaibla^ 
aqulpaanta  wera  eatagorlzad'lato  funetlo*»l  paiekacaa/  awt  duplleationa 
ellalnatad. 

Mlaalla-bome  eraetroolea  vara  axsludad  by  Shairaan,  AQRSI.  -  In  . 
tha  eouraa  of  tha  taak,  tha  sajor  air  dafanaa  data-hantfUct  eT**‘aae  la. 
tha  thraa  aervleea  (SACS,  .Kaval  taatleal  SaM  Syttan  and  KISSliSHIASnil) 
uara  azeludad  baeauaa  of  thair  eonplaa  ralatlan^pa.  SaadXaaa/ 

to  aay,  those  aroaa  ara  of  priiw  lapprtaaea  and  ara  roecaaeadad  for 
separata  study.  Noneoabs^t  aqitlpaanta  and  Beetirlty*aansitivb  adulp*  ^ 
aents  wara  also  axeludad.- 
3.2  Equlpaenta 

The  equlpaents  selected  ara  listed  In  Apperdlcas  C,  P,  and  B.  ' 
Ihese  hsye  been  generalized  Into  clBt5i!5  of.  equlpaents  whleli  ara  plannad 
for  use  about  i960.  These  generojilzcd  equlpaenta  arc  classified  Into 
spec  trie  desses  or  types  SXetlar  to  these  ncu  Ir.  use:  bjehlng-nsYlga- 
tlon,  A1  radars.  eoBBunledtlon  seta, 'etc.,  for  Amy,  Msey  and  Air  yorea 
use.  They  were  selected  accoi^ing  to  the  folloulng  criteria:  (1)  la- 
portsnce  of  tha  aisolon;  (2)  tha  Isportance  of  tha  aquipaent  fallura 
to  the  olBslon;  (3)  the  ii^ortance  of  cquipaent  fsllure  to  safety;  (b} 
the  length  of  tfie  required  cpersting  tlac,  (5)  seirerity  of  environaents; 
and  (6)  coaplexlty  of  the  equlpaenta.  In  other  eords,  the  selection  uss 
made  on  tha  basis  of  the  relative  iiqjortscca  of  the  ralle'slllty  problaa. 


3*3  Souratt  tnd  Type»  of  infonatlon 

To  put  tht  results  on  ss  Nilistle  s  bssls  si  possible*  eonsldereble 
effort  was  put  into  eonuotlns  verlous  staffs  jognlssnt  of  operational 
needs*  Operational  conaandera  and  other  experienced  personnel  who  were 
faalllar  with  current  and  future  tactical  usage  of  electronic  c<iulpacnt 
were  contacted.  Operating  personnel  In  general  can  estlnate  the  mlhlmuM 
acceptable  probability  of  success  of  a  mission  more  readily  than  the 
•Inltuvn  acceptable  reliability  for  a  particular  electronic  equipment. 

This  mission  is  generally  expressed  In  terns  of  an  objective  of  a  combat 
unit*  a  weapons  system,  or  some  other  orgaraaatlonal  unit..  These  units 
have  a  more  or  less  clearly  defined  mission  and  length  of  mission  tlM. 

Xn  the  case  of  airborne  equipments*  the  operational  people  were 
requested  to  estimate,  the  minimum  operaclohal  reliability  figure  for  a 
weapons  system*  and  also  to  determine  the  Importance  factors  of  the 
various  electronic  equipments  In  the  eyatem.  With  this  Informstion  svail*^ 
able.  It  la  a  simple  matter  to  compute  the  reliability  figures  for  the,' 
.various  electronic  equipment.  The  setusl  method  used  for  allocation 
of  a  aystec  re-llittilllty  to  aubsyatems  reliabilities  is  given  in  Appendix 
B.'  • 

1'  the  case  of  aurvell lance 'equipment  (shlpbome  and  ground),  the 
mission  lengths  are  not  well  defined*  and  malntenane**  can  he  started 
Immediately*  so  the  operational  commander  therefore  Is'  primarily  eon- ' 
cerr.ed  with  the  rercentage  of  down-time  over  an  extended  period  of  . 
operation.  -The  percentage  nf  down-time  Is  a  function  of  the  reliability 
and  th?  maintenance  time  required  for  the  eyatem.  Therefore,  Irt  a  num¬ 
ber  of  cases,  the  approach  in  taking  the  problem  to  the  operational  etaff 
was  to  obtain  an  estimate  of  tne  percentage  of  down-time  allowed  and 
the  length  of  Oown-tlmc  required  for  an  average  maintenance.  Wit; 
these  two  figures  and  the  use  of  simple  probability  theory*  tbe-mlnimtm 
acceptable  reliability  of  the  equipment  can  be  determined  and  in  each 
case  the  equipment  reliability  wss  converted  to  a.n  equipment  mean- tine- 


failure.  .  The  Mthodi  of  analyaio  used  for  thi*  purpoM  or*  (Ivon  In 
Appondleoa  C  an^  0. 

With  due  ragai^  to  tha  above  proMena,  Queatloimalrea  Mere  pr:« 
pared  and  mailed  to  varloua  ^MUcnal  croupe>  In  advance  of  the  per* 
aonal  Intervlewa.  The  purpose  of  the  questionnaire  ms  to  supply  the 
interrteMee  with  background  infortaatlcs  aad  the  questions  for  which 
answera  were  desired.  It  was  hoped  that  the  answers'  to  the  question* 
naire  could  be  formulated  prior  to  the  interview.  However^  the  Task 
Group,  realizing  the  difficulty  of  transmitting  information  by  letter 
on  such  a  subject  as  reliability  where  there  are  few  eomon  eoneepta, 
used  the  interview  to  assure  that  (a)  those  Interviewee  understood  the' 
problem  of  Task-croup  No.  1,  and  that  (b)  lanisuaga  was  not  q  barritr 
to  obtaining  the  results.  The  interviews  were  used  to  effect  a. mutual 
understanding  of  the  problems  of  each  service  as  well. 

RESULTS 

The'  minimum  aceeptsblllty  figures  which  have  been  developed  in 
*  ■  *  *  »  *  ’  • 
this  lnve8tl.;stlon  are  presented- in  tables  £  -  lY,  This  aactlon  is 

devoted  to  explanation  of  these  tables,  discussion  of  their  accuracy 

dnd  adaptations  which  should  be  made  in  their  application.  . 

•*.1  Explanation  of  Tablet  l-iv  *  • 

Flgi^es  for  sdnlmuB  acceptable  mean  life  are  given  in  trie  tablet  ' 
for  the  various  equipments  listed.  The  t*h<rsl  approach  to  the  deyelop- 
ment  of  these  figures  has  been  discussed  In  tne  preceding  sections, 
and  further  details  are  presented  in  the  appendlcea. 

In  the  case  of  shlpbOrne  equlpaents,  figures  are  also  given  for 
Blnlffiuaj  acceptable  percentage  up-tlae.  For  the  most  part,  these'  are 
the  figures  which  were  developed  directly  Ir.  tnis  phase,  since  this 
figure  of  me  .’it  reflects  operational  nee;'s  core  appropriately  than  mean 
life.  The  tv. aversion  to  mesn  life  figures  was  ty  means  cf  the  asaxiaed- 
value  of  average  aow.-,-:lse  per  failure  .[oital.-.ed  from  VITRO  data),  the 


•caa  lif*  figure*  •hould  b*  aor*  tu*e«ptlbl«  to  test  then  the  pereentege 
up>tla*  tlguree  ea4,  Be^prer,  it  Is  iaportent  that  they  be  swt  (sel4»': 
froe  the  pereentege  up«tlM' ettelned)  to  that  aalntananec  faeilttlea  4o 
not  beooa*  setursted  (tee  Q  t.6  In  Appendix  D).  Xt  le' Intended  that^  If 
feasible,  both  the  percentage  up*tlM  and  aean  life  figure*  be  d*««i>  - 
strated  In  acceptance  testing  of  shipbome  epulpaent. 

•  It  Will  be  noted  that  for  convenience  of  generalization  the  equip- 
nents  are  listed  here  and  elsewhere  In  the  report  according  to  their 
functions,  rather  than  according  to  the  specific  designations  which  - 
were  used  durinr.  the  course  of  the  Inveetigation. 

In  the  esse  of  airborne  equipsents  which  are  duplicated  in  the  eon-  ' 
figurations  considered,  the  rigures  represent  the  aesn  life  which  should 
be  demonstrated  by  a  single  equlpuent  under  the  essuaption  that  there  are' 
two  on  board,  either  of  which  auffiges. 

In  the ‘aircraft  tables,  there  are  several  blank  spaces  where  the  - 
equipments  were  either  ne  t  on  board  .or  no  figures  have  been  developed.  .. 
The  omitted  equipments  are  presumed  to  have  their  requirements  deter-  .  . 
mined  by  factors  other  than  those  which  were  analyzed  directly  fbr  tne 
aircraft  in  question  (e.gi, mission  succe'se,  safety,  aircraft  defense). 

Seme' very  useful  equipments  such  as  TACAK  and  autopilots  are  frequent 
examples  cf  this.  Their  loss  nay  represent  Ireohvenlence  or  diecoafort 
■ihlch  ma.y  or  nay  not  have  an  effect  on  mission  success  or  safety—  - 
:hls  is  hard  to" incorporate  into  the  analysis.  Radio  requlreoents  in 
some  cases  are  governed  by  training  needs,  vnloh  were  not  considered 
here, 

*  ■  2.  Accuracy  of  the  Results  _  - 

It  should  be  borne  carefully  in  mind  that  the  basic  numbers  fri-m 
which  tiiese  results  have  been  derived  are  cf  opinion,  anJ 

widely  different  opinions  .have  been  offered  In  sone  coses.  There  is 
ver;.  little,  if  any,  precede.nt  fer  most  of  this  Inrornstlon.  By  the 
sar-.e  tcicen,  it  can  be  very  valuable  es  c  starting  point,  but  it  sho.uld 
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be  remembered  that  thee#  results  oonetltute  no  more  than  Juat  that. 

They  are  not  repreaented  aa  being  hi^iily  aceurata  nor  do  they'  purport 
to  be  official  expreaalons  of  the.  acrvleea.  However^  it  nay  be  aald  ' 
that  they  hove  a  good  baaia  in  unofficial  expreaalon  of  operational 
tteeda.  The  methodology  Itself  should  be  very  useful. 

In  Section  3  we  shall  dlscuaa  further  qualifications  and  nodlfl* 
cations  that  would  be  needed  even  If  the  present  results  were  highly  . 
accurate  In  terms  of  the  adopted  definitions. 

A  further  qualification .should  be  cited  In  that' It  haw  been  necessary 
to  generalize  considerably  from  apeelal  eaaaa,  e.g.  special  combat  situs* 
tlona , 

It  would  be. moat  desirable  that  the  services  conduct  future  system 
st'idles  to.  determine  the  values  of  the  basic  Inputs  to  the  analysis  more 
accurately  than  has  keen  possible  In  this  Investigation.  Importance 
factor! particularly  should  be  susceptible  to  anaiysia. 
b.3  Adaptations  in  Application  of  the  results 

In  applying  these  minimum  acceptability  figures  In  the  formulation 
of  reliability  requirements,  one  should  first  examln.e  .various  ass^* 
tlons  which  underly.  their  development.  It  is  possible  t'hat  a8iu!!>ed,j*^n,- 
dltlons  will  fit  the  problem  at  hand  fairly  closely,' or  at  least  In  all 
b<'  a  few  respects.  Insofar  as  any  differences  In  conditions  are 
measurable.  It  should  not  be  hard  to  modify  the  numbers  accordingly. 

This  Is  particularly  true  for  tha  airborne  equipments.  Here  the 
formula  used  to  compuct  minimum  acceptable  mean  life  la  essentially  a 
proportlorjallty  formula  ao  that  the  effect  of  changes  In  Inp'iiis  can  be 
computed  rather  simply,  ?or  example.  If  one  conalders  that  the  mlnio 
mum  acceptable  probablllf.,  of  mission  success  be  .60  Instead 

of  an  assumed  value  of  .90,  this  has  the  effect  of  halving  the  mean 
life  r.equlrements  across  the  board  for  all  equipments  governed  by  mlaslon 
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success,  i.e.,one  multlplxes  esch  nesn  life  by 
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Tog,  To  i  -  .8 

If  one  considers  that  the  iDportftnce  factor  of  a  given  equipment  should 
be  doubled,  then  Its  mesn  life  requirement  Is  doubled.-  The  same  holds 
for  operating  time.  Changes  In  module  count  required  can  be  handled 
similarly. 

As  discussed  at  the  end  of  Appendix  B,  It  would  be  desirable,  when 
allocating  the  requirements  for  a  particular  aircraft  weapons  system  over 
its  equipments,  tn  use  some  basis  other  thstn  module  eou.it  *-o  account  for 
Inherent  relative  difficulty  of  attainment.  .... 

Comparison  between  Air  Porce  and  Navy  Air 

The  problems  Involved  In  the  Air  Force  and  Navy  air  phaeea  of.  this 
Investigation  had  much  In  common  and  the  methods  used  were  generally  simi¬ 
lar.  However,  in  comparing  these  two  appendices.  Important  contrasts 
are  apparent.  As  a  general  explanation  for  theae  differences, It  is  re-. 
marVed  ^hat  there  are  real  differences  between  the.problema  of  these 
two.  services  and  In  addition  these  separate’ phases  were’ studied  inde¬ 
pendently.  *'  ■  ■  ' 

The  most  striking  difference  is  that  the  assumed  values  of  mini¬ 
mum  acceptable  probability  of  miasion  success  are  higher  for  the  Air 
Force  aircraft  than  for  the  Navy  aircraft.  The  beet  explanation  for 
this  difference  la  that  these  respective  phases  of  the  investigation 
were  conducted  Independently.  This  particular  parameter  is  more  s’ 
matter  ox’  opinion  than  are  any  other  numbers  in  the  report.  Indepen¬ 
dent  opinions  csn  vary  widely  and  beyond  this  It  appears  that  the  Navy, 
figures  were  devs^oped  amid  thlnxlng  which  regarded  the  meaning  of 
minimum  acceptablll’-y  In  a  more  severe  light  than  waa  the  case  with 
the  Air  Force,  l.e.,  the  navy  figures  seem  to  reflect  the  absolute 
mlnl-tum  acceptahlllty  ard  an^  value  lower  than  those  abated  would  re¬ 
sult  In  Immediate  drastic  action  to  improve  relisoillty.  •Th.e  differ¬ 
ence  waa  not  derived  from  any  feeling  on  the  part  of  the  Task  Croup  as 
vO  the  relative  Importance  of  aircraft  types  in  the  two  services. 


TABU  2 


Sumaary  of  Reeoanended  Minimua  Aec^tcfblllty  • 
i^lKuree  for  A  ray  £qulpiene 


Mean  Life  In  Houra 

Tactical  Vehicular  Com.  Set  160 
Mobile  liong  Mange  Caaa.  Set  460 
Radio  Relay  Coma.  Set  {800 
.Mortar-  Locating  Radar  Seta  480 
SAM  Control  Battery  46 


TABU  XI  '  •  ; 

Suaioary  of  Recogaeoded  Minimum  Acecptablllty 
Figures  for  Shlpborne  Equipment  . 

Communications  Egulpaenta  (Aaeuaea  6  Hra.  Doan- per  Failure) . 


Tranemlttera 

HP 

W/af  CV  HI  Power 
UHF  Auto  Shift 
UHP  Manual  Shift 
VHP 


It  Pp-tlme  Mean  Life  In  Hrs.R 


98.SS 
96. 55^ 
97.5Jt 


165 

Hi 


Receivers 

W/m/Kf 
•JMR  Auto  Shift 
V;!F  Manual  Shift 
VHP 


96.5* 

9V.5Jt 


234 

494 

16S 

234 


T^rr-insl  . 
Telfttype/Facs. 


97.5Jt 


HCCE:  *1i'.e8e  flg  irer  are  Icnovr  to  be  generally  belcv  what 
la  now  being  att.aJr-ed  (seo  C-t,6  In  Appendix  D  In 
Iho  classified  aupplecent),  Therefore,  section  5.2 
'Is  particularly  applicable,  ^ 


Mr-t  s^  vjar'c  ^ 


•Rar^urf. 


U&1&  II  (Cent.) 

Equipments  Other  Than  Coomunlostlon  (Assumes  12  Hrs*  Down  per  Tsllure) 


Air  Detection  end  Control 

Air  Search  Radar 
Helght-Plnder  (Incl.  Dlapl/) 
AEW  Terminal 
Interrogator-Resnonsor 
ECK  Intercept 
Standard  Radar  Display 
Orr-Center  Sweep  Display 

Carrier-Controlled  scproaeh 

Pinal  Approach  CCA  Radar  ‘ ' 
tending  Speed  Ind.  Radar  . 

Navigation  (Ship  and  Aircraft) 

TACAN  Transmitter 
^-Band  Beacon 
UHP  RDP 
MP/RP  RDP 

Surface  Search  Radar 
U)rAn  Rovr, 

Ship  Identiflcatloh 

Transponder 

Sonar  *  •  ■  *  . 


%  .Dp-TliBe  Wean  Life  in  Hre. 


95.5* 

■ 

sH  ' 

188 

9m  ■ 

120 

9J^.5S^. 

212 

95.a» 

■  94. at 

248 

212 

•  -96% 

gm 

.  120  - 

Bat 

68  • 

94% 

188 

91%  . 

121 

•  9H 

,  188 

91%  . 

121 

98.8% 

870  . 

90% 

108 

92.5% 

.  145 

Detection". 

.  .98%  . 

Tracking  . 

95% 

Sub  Identification  , 

* 

94% 

SAM  Control  (CLO) 

2  Target  Capability 

1  Terget  Capability 
Tracking  Radar 
Guidance  Radar. 
Computer 

70%  ■■ 

•  93.8% 
90%' 

•  95.5% 
97.7% 

& 


per  failure. 
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IV 

Stiaaary  Of  a«»<c^nw^i  yr.lBUM  Aeeepttbillty 
'  FIgurca  for  Air  riree  Eaui^ont 


Fean  Life  in  Hours 
^yate&a 

for  Weapon 

C  omaunl ca  ttona 

Lcweat 

Hlgheat 

CKP  (7r,-Rec.) 

60 

79 

.HP  (Tr.-Rec.) 

To 

IntercoM 

37 

640 

X>ata  •  Link 

a:> 

46  . 

Navigation 

•  • 

Co'^aaa  (Flux  Cate) 

•  S?3 

362 

AGFI 

16 

145  . 

Rendezvoua  Beacon 

-  J20 

470 

Pilsht  Control  .  . 

* 

Autopilot  - 

10 

Flight  Horizon 

I60»e 

.680 

Fire  Control  . 

• 

Ranging  Radar 

.  -ti  .  . 

6a  •  , 

>S 

acnb/ICav.  Syatea 

.Hiaaile  Fire  Control 

23 

23 

Sight 

315  . 

il 

108 

•Air  Data  Cosputer 

Boailng  Cocp-oier 

eo 

.  .  icS 

.  “fd«r .Control  Rcvr,  Beacon 

••  lU 

l%4 

Identification 

• 

IFF 

■■  .£3’  ' 

,  83 

Aircraft  Defense 

rati  Turret  Control 

’  13  . 

•18 

HCK  Unit  (Rc-’r  i  Cacaaer) 

216 

216 

♦itr.ere  the  ease  fjgura  af.uwa  In  both  cciuisr.s  It  meaj.a' that  ' viic 
e^ulpienl  aaa  atuiliJ  in  connection  vitn  only  one  of  the  Ueaaon  ■ 
Systeaa. 

••  Assuaes  2  Inatsile'i,  each  capable  cf  carrying  the  entire- load. 


5.  ADPinOWL  COMSIPEPJITIOHS  IH  SKglffryjC  eQUIPHEMT  RBUABILITlf 

There  ere.  loportant  coneldei^sti^r&e  in  Otvelepliig  rclleblllty  re¬ 
quirement*  which  »re  beyond  the  •cof>e '>f  tasK.  These  are  (!*»•. 
cussed  In  this  eeotlon. 

5.1  Environment  ‘  ... 

All  considerations  In  tb'*-i  re^or  to  operational  eondl> 

tlons.  Therefore,  IT  the  Blnlmuis  ti;«tptat>lli%y  figures  presented  here 
are  -used  as  bases  Tor  acceptance  ttsjblng. the}'  should  first  be  adjusted 
to  allow  for  '»he  change  from  the  Usit  tnvd-rciwnent  In  question  vo;  the 
operational  environment  in  questAOit, 

5.2  State»of .the-Art 

The  next.  Mtage  in  determining  eonC^rsctual  reliability .  require¬ 
ments  is  to. examine  existing  reliability  ^nd  the  future  atate>''r - tite« 

r 

art  to  determine  hew  much  relisMlit/  1>  r’afisonably  olthln  reaob  from 
the  technological  standpoint.  Ihit  cviuidarstion  has  ent’efed  into  this 
report  only  in  a  gross  fashion.  It  s>^oui(f  result  in  design  goals  thbt  '' 
are.  subatantially  higher  than  the  i)iinX.i»iaB  preaei.ted  her*.  It  will  re» 
main  further  to  determine  rel.'abiiiti^B  which  are  optlaua.  In  aome  sense, 
in  view  of  the  various  ebiig>roaleoa'  sA>ould  be  struck  aa  diScueaed  ■ 
In  the  remainder  of  this  section.  .  '  ' 

5.3  Other  Performance  Peatureg.  .  -  • 

In  many  aituetions,  unreliability  la  incurred  by  atretehing  the 
state-of-the-art  In  aome  other  aspect  performance.  All  perfunrance 
reacur''8  (including  rellnblllty)  of  t  m^etp^yng  syateo  should  ba  balanced 
in  a  way  which  maxlmlrea  over-all  pJ*or«t>Hl^y  of  auC.^eSs.  An  excellent  . 
example  of  thle  la  the  approach  taKcti  A?}  R.  P.  Mettler*  w.ho  considered 
tne  .trade-off  between  accuracy  of  s  boatclag-nevlgatlon  ayatem  (high 
accuracy  required  high  complexity)  anj  rcliaibtiity .  Optimum  reliability 


’r!.  ?.  .MV t tier,  nori:rt:  er-.!  Kn/lreiicn  for  yAUf.c-i  Otrat''rlc 
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f. 

8 

•1  ■  ■ 

]  w*9  tfetcQolncd  fcr  an  oparational  rMuirtaant  In  •  war  «hl«h  MUUalMd 

I  '  *  .  ■■ 

^  over>all  prcMMIttjr  cr  target  deatruction  eonaldereiS  as  a  product  of 

•! 

i  ^  cooponent  prot«tlIlt2e8,  one  of  which  waa  rcllabllitj. 

[  Weight  iai  alee  should  be  conaldered  In  this  light  alao^  since 

I  ■  •  • 

I  additional  reliatiXlty  can  always  be  bought  with  r^uodai^y. 

I  . 

I  5*^  Cost 

"  Cost  la  as -interwoven  wlfh  reliability  that  It  has  been  difficult 

for  the  task  gro^:  ts  avoid  cost  considerations  in  developing  clnltttoi 
acceptable  reliability  figures.  .  As  a  aid#  laaue.  In  order  to  throw  soot 
light  on  the  problea  of  coat  of  reliability  another  type  cf  optlaua  re¬ 
liability  was  Inrestlgated.  This  optiaia  reliability  la  that  reliability 
which  sdnlelzes  total  cost,  considered  as  the  sua  of  dcvelopaent  cost  '  ■ 
and  operational  coat.'  Appendix  F  by  R.  R.  Carbart  a:-<d  S.  R.  Herd  de- 

:  -  velcpa  a  a^thod  of  detemlning  the  optiauaa  reliability  based  upon  a 

alaple  cost  .-Bodel. 

I  5.5  Kalntenenee  load  . 

<  ' '  '  " 

'  In  seise  cases  th*  deteralnlng  factor  for  eatabliahing  •InlMs  re¬ 
liability  redulrener.ta  suiy  be  the  saturation  of.  BaintenaAce  facilities; 
This  consideration  has  been  brought  to  bear  In  thla  report  in  the  ahlp- 
bome  phase  only,  hut  It  should  receive  soae  study  Ip  the  other  cases 
also,  especially  in  cases  of  equlpsenta  which  are  very  n-oaeroua  within 
the  same  type.  *  . . 

■  5*^  AvailsMllty 


Of  the  vsrloja  piMltles  that  aust  be  paid  to  Isprove  reliability, 
.delays  In  availability  will  probably  present  the  most  clfflcJlt  decisions. 
Th#  problem  is  pointed  up  by  differing  comments  offered  by  two  flag 
officers  during  the  Saval  phaae  of  the  Inquiry.  One  ccr.si-dered  that  the 
most  pressing  prehlea  was  long  lead  time  And' ufge-J' that  availability.  In 
general,  not  be  held  cp  by  ultra-refinement  during  developaent.  The 
other  considered  that  we  a.iould,  in  general,  keep  equlpnerta  in  develop¬ 
ment  until  extremely  .-igr.  reJ lability  standards  have  been  net. 


*5 


k  r  xi-SA-w jfWwWKW  v»  v»  v* 


Tilt  rt«poiur«l»  our  Inquiry  tendod  to  pine*  JiighAot  rtllatllity  ?•» 
qutreaonto  mi  the  tqulpnont*  with  hi»hoot  nilltnry  vnlut.  Pet  tho 
tene  priority  oquipwenta,  groat  proaiuro  la  often  present  for  rapid 
laprovenent  in  Other  perxoraeoee  featurea.  Theae  requlrewenta  tend  to 
be  In  sharp  eonfllet. '  In  aone  eases»  the  wlaeat  decision  olght  be  to- 
accept  the  operational  introduction  of  a  new  equipment  whose  reliability 
la  leaa  than  the  nlnlaua  acceptable  figure  presented«  here«  in  exchange 
.for  a  vitally  needed  early  stride  forward  la  none  other  perforoaneo 
feature.  Per  exaaple.  a  certain  high  priority  radar  function  night  sail 
for' a  nlniaua  acceptable  reliability  of  95  per  cent.  Suppoea  tha  ax** 
iatlng  equlpaent  perfo.'vlng  thia  funetion  la  h^leaaly  obaeleta  in  . 
tema  of  range.  One  night  well  aeeept  the  early  introduction  of  a  m>' 
dar  relieving  the  range  ahorcconing.  even  tho'agh  its  ^liability  la 
only  7C  per  cent,  on  the  ground. that  la  better  than  the  alternative 
which  la  'e  uaeleae.  although  preaumably  reliable.,  radar.  It  ia  reeoa* 
nended  that  a  aervice  which  ehooaea  to  nake  aueh  an  exception  ehould 
Boxe  thia  deleralnatlon  before  the  aceeptenee  teatlng. 

The  reaeon  thie  anooely  nay  arise  la  that  the  inquiry  leading  to  the  -' 
figures  presented  here,  was  concerned  '*ith  a-^’ady-atata  reliability  ra> 
qulreaents  Imposed  by  various  functions  in  the  foreseeable  future, 
without  regard  for  the  need  for  i^iroving  performance  features  of 
'.qulpnents  presently  performing  these  functions.  As  a  general  rula.  it 
should  be  required  that  the  introduction  of  a  new  equipaent  providea'-a 
substantial  stride' formri  In  one  or  more  performance  feeturee. 

Occasions  My  eriae  wherein  a  new  piece  of  equlpdirnt  is  brought  for> 
ward  which  perfonta  a  fur;-,ion  hitherto  not  performed  by  any  other 
equipment.  The  fact  that  the  reliability  of  such  an  equipment  is'  well 
below  gei.crally  acc-pted  atendarda  ar.ould  not  neceese.-lly  preclude  its 
introduction  for  acr-.-jLce  use.  Orjce  again,  the  decision  es  :o  whether 
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LT  t.  ' 

f.~.  «  .,  ,„k.  „  „„  ^ 

•M  reUtttut,  V  th.  M„.  .0».«.r.„«. 

5«7  General  Reaarka 

Kaiv  proble.ui,  ^eeirication  of  equipMnt  Pel  lability  beyond 
the  aeope  of  thl.  t.eh  thua  P«.in  to  be  .tudled:  «,i.  i.  „ot  to  i«y 
that  the  ianl««  aeceptabiltty  fi,«ro.  preeented  her.  are  not  1.,^.  • 

Til  “««■>•  »».  thin,. 

■  E.«i  mmaUM,  «,...  «proa„t.  »im.„ 

rap  better  than  none  at  all.  whi/.h  la  a  •* 

i  »»  i»  What  dealgnera  generally  have  for 

Mint,  .t  a.  ^ 

7T1T’  *’  “*  '•- 

•PWlt  or  rirot  .M,r«a„„»  tut  tl»  0.0  „  ti,«  „p.«  u 

■ended.  •  •■  ’ 


6  HECOMWEWMITIOWS 


A»  •  result  at  the  inveetisetlon  reported  here,  T»ek  Group  Number 
Oiie  rcscaoMttde  thett 

-(e)  The  Blnleuii  eeeepteble  reliability  figures  presented  in 
Tables  I>1V  be  adopted  by  AGREE  on.  a  flrstoapprarlaation  basis.- 

(b)  Before  application  of  these  figures  in  particular  inataneea,  . 
the  appendices  to  .this  import  be  reviewed  to  deteraine  whether  the 
underlying  essuBqi>tions  are  consistent  with  the  application  in 
<|ueatloa.  ■ 

(c)  As  tine  and  effort  for  eddltional  study  becoae  available,  - 
these  figures  be  Modified  with  regard  to  test  envlronaent,  stats'- 
of-^the->art,  conproMiSe  with  other  perfor«aoee  features,  cost,  ' 
Maintenance  load  and  availability. 

(d)  Father  than  sake  no'speeifieations  in  view  oiT  the  long  delays 
that  these  edditionbl  studies  My  require,  such  .Modifications  be  '. 
Made  by  ewtsidered. opinions'.' 

(e)  Special  studies  be  Mde  to  establish  reliability  require* 
.iMAts  for  the  Mjor  sir  defense  dsts*hsi^ling  systeu  such  as  SAGE, 
Naval  Tactical  .Outa  Systen,  and  MISSILB-KASTER,  and  fcr  ar.aatlc- 

•  ...  •  -r 

bonw  electronics  equlpnenc.  ■ 
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ifPOQS  A 

rtm  tKlliWltty  FWwtlow.  ><t)  s  •**/» 

In  this  appsndix  s  AsrlTstloa  is  eltsn  fcr  ths  sxpoMatlsl  nlisblllty  foniuls* 
Vslsss  srs  tsh'Ustsd  la  tshls  A  1.  ' 

Su|>po8s  that  s  larx#  tnsibsr  of  slteironle  sqfolpM’auof  o  (Ivsn  typo  wars  soployMl 
slKuItsnsously  1a  s  slngls  lastsUstlsa.  Xt  is  Ms'il  knom  thst|  if  no  rspslrs-  srs-  iMds« 
the  quantity  of  squiiMnt  vortcliijt  stitlsfsetbrlly  will  dsmsss  with  ttas>  Supposs  ths 
(tatSriorstlon  of  ths  quantity  la  lR«msl/  proportlonal.to  ths  quantity  of  oquirawatSi 


that  is 


(1)  dQ  a  -kQ 


whsro  k  is  ths  Toloelty  constant  of  this  dstazioratlon*  Than  ky  soparatloa  of  vsiiablss 
this  dlffsrsRtlal  equation  is 

(2)  ^s.jedt.  *.  •  '  ■■•1  . .  . 

tJpoB  latsgrstloa 

(3)  log  Q  s  ^Ict  ♦  A 

whan  A  Ineludss  ths  ccnstanta  of  Intsgratlon*  Thsn^ 

(h)  QSQjS-*^ 

vtisrs  Qg  Includes  ths  eenetants  of  Integration  o^* 

An  intorprotatlon  of  aquation  U  Is  that  Q  Is  ths  quantity’  survlring  af tar  tins  t 
where  is  the  quantity  atarting  at  tins,  t  »  0. 

Dlridlng  both  sides  of  (()}  ty  Qg  the  fi action  surrlrlng  or  the  probability  of 
sunrlTal  Is  obtained  f 
(5)  R(t)  ^  s-kt 

The  reitibility  f-oncixon  {S)  ie  a  fus.ct.on  of  tins  with  one  parameter,  k,  the  atsloclty 
■io.TsUr.t  v,r  doteri&ratl-Dn,  It  can  re  ,wn  that  ths  (.oisitant  is  the  reciprocal 

of  the  rnnn-tir.o-to-fallure* 


q  irfVJ  f- 


Thli  Mjr  b«  than  datendaiat  «mt«old  of  tte  prababilitgr  dlatrltMtioa  of 


Irasth  of  llfo  tlBoo«  4oflaitlen«  thla  oontrold  io  tb*  bomi  Ufo*  Tho  MUobUtlgr 


fuaetlor.  lo  tho  probobUltr  that  usy  Itfo  iliM«  x,  la  grootor  thaa  ooao  ilao  i  iMilA 


Mjr  bo  wrlttoa  M 


(6)  f(xa 


‘>'7 


f(x)*t «  H(t) 


vhoto  f(x)  la  tho  frotpioao;  dlatrlbotion  of  Ufa  tiaoa.  Siaeo 


«mCtlsa  g> 

db  3t  r 


f  (x}dx  s  >f(i) 


(7)  f{t) 
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4i*d  txm  {$) 

(8)  ,f(t)  Sko-W, 

Tho  eentrold  or  oxpootod  Ufa  (Bo«»>tlaa-:t».follvra)  it 


a  s  ^  tffCt)dt  s  ^  kta'^'dt  a  | 


and  k  a  X  • 
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Tbanforo  ($)  ao*  ba  arittaa  or 
(9)  K(t)  »  a~*/^. 
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AUoemtlon  of  Syat^n  Fkllw  IUU« 

■  B  1  Introduction 

In  this  appendix  m  consider  the  pr^Mei*  of  trsMUtlnc  ajneten  reUxtillty  require* 
nentd  Into  requlrmnta  iicposed  on  suboTstens.  Spee^Ieellyf  the  Mthod  developed  li« 
in  effecti  .an  allocation  of  a  apten  failure  rate  aa  a  eui  of  failure  ratoa  of  the 
aubsTstenst  later  «»  shall  apply  this  Mthod  to  aircraft  Mapena  STataea,  and  therefore 
M  proceed  here  in  this  airborne  context.  Actually  the  Mthod  appUse  generally  to  any 
systCM  which  can  ba  deeoapoaad  (approximately)  as  a  aariaa'of  Indapandani  eubeyateap. 

Tha  Mission  aueoesa  oonaidarabion  nay  be  replaced,  for  axaaple.  by  aafeiy  of  fU^t  .or 
aarrlwl  of  enesQr  action.  '  . 

8  2  Cerlvatlon  of  the  Allocation  Fowaula 

.  Consider  an  aircraft  with  k  equipnenta  assuaed  to  be  independent  apd  in  aerlea  . 
in  their  affact.vn  Kiss  ion  suecass.  SacK  equipoent  la  aaauMd  to  eonslei  of  lndapand> 
ant  standard  nodules,  one  for  aach  tube.  (Allowance  for  dv.pliQatiooa  a.nd  solld>atate 
substitutes  for  tubes  will  be  dlaonssed  later.)  let 

f  *  probability  that  the  aircraft  Mission  will  not  fall  dua  to  electronle 
failuie. 


and,’  for  i*l|....  k.  lat 


xj  •  mean  Ilfs  of  the  equipoent. 

ti  ■  tiaa  frcm  take-^ff  until  the  i'**  equipoent  le  no  idnpcr  needed. 


I 

1  •  •  • 

,  • 

UslB(  ttMM  d«flnlUoM«  th«  Uloeatlon  fo»uU  ua*!  In  later  apimdtoaa  on  alrtoraa 
ayateu  la  aa  fsUaaat 

»  witi  * 

Hare  m  consider  the  eeluea  of  ni  end  P  to  be  tcLnijnBi  eeoepteblo*  Wa  abeU  t^aeiitljr 
darlee  this  formOa  under  the  assuned  requireMnt  that  each  aodtila  Mica  an  aqpial  ooa> 
trlbutlon  to  nlsslon  aucoess,  and  later  ve  djgMeo  sows  rdeptatlona  to  be  nada  la 
Its  application,  first  1st  tis  exsains  the  foncula  Intultleeljr. 

Note  that  the  required  Man  life  increases  tdte  iiqportanea  and  ttea  t^  and 
decreases  with  relatlM  aodnle  count  niA(*  ^te  la  clearly  aa  it  shoeild  be.  That  the 
rolation  should  te  proportionality  is  obrloua  as  regards  ti,  possibly  not  aa  obvioua  aa' 
regards  and  ni/f,.  finally  note  that 
•Isg^f :%  1  <•  P> 

so  that  by  rsolprc  eating  the  fon>ula«  It  la  seen  that  the  ellcwed  falisre  rete  ]/■! 
la  ellocated  ea  a  portion  of  the  systen  failure*  rate.  This  mch  has  Inteltlve  appeal. 
It  My  be  argued  that  addltldnAl  factors  shonid  enter.  Into  tha  allooatloa>  but  thdaa. 
treated  ahote  are  .considered  t-o  be  sufficiently  goremlng  for  tie  preeiat  purposes. 

To  .d'lriee  the  formila  we  note  first  that  (assunlng  exponential  fellnra  bthiavlor)  ’ 

V  .  •  .  • 

•  f  e  rn  (I  «  wi(l  -  axp(«  tj,)/).'  . 
i»l  ,  1^ 

I!y  using  the  approxlMtlon  exi:<(x)  ‘Z  Itx  this  esn  be  slnpliflad  to  ’  ' 

le  •  •  .  ,  . 

in  '• 

Here  tiie  approxiaetlon  has  beer.  ^pUed  twice  in  opposite  dirsctlons  so  that  srrors 
cancel  in  i>art.  The  accuracy  Unite  of  ths  approxlMtlnn  aro  discussed  In  the  next 
section. 

Tie  requlxeoente  ew  carried  to  the  nodule  lerel  by  settlsg  laj^  ~  for 

lal,...^lc,  so  that  Ti  Is  the  nean  life  of  each  ncrtule  In  the  l^**  equlpnent.  We  now 
repard  the  above  expression  for  P  aa  a  product  of  S  factors  which  ve  require  to  be 
eq'wl,  l.e., 

exr(-  m  )  S 

K 


1.  ▼if*  ■.‘irwW  wr*  w*l; 


lartk  rnrm  teHsftr-tfii  wv  tell  im  te*  a/w  lT* 


TIim  tlM  •ptoUrie  bMla  of  tllxi^tlon  nMd  la  to  raquiw  that  aaeh  nodala  aalca  an 
•qual  contrtbuttan  to  wlawlon  mieeaga.  It  follow  ttm  ttla  oqaatlM  that 

^  oj 

an)  tha  alloeatlon  fonttla  la  tharabj  4tri«ad* 

Th»  foUowlDg  fictitioua  axanpla  Uluatrataa  tha  appUeatlon  of  tha  feraulat 


P  ■  .9  (min.  aco.), 

n  w  t 

•lofa^  2 

m2  12000  « 

(r1i>.  aec.) 

RC7R 

.7 

k  bra.  . 

iiZO  iin* 

sirs 

30 

Ji 

It  hra. 

200  hra. 

RAdAX 

200 

.8 

ti  hra.' 

tiSbra. 

m 

JO  ■ 

.2 

•  U  hra. 

ti6  hra. 

300  2 

Sa 

B  3  gxeaptlona  for  Rmlpwanta  of  Toa  Icportanea 
In  a^uipoenta  pf  lew  laportanea  it  my  not  ho  peaaihla  for  aacb  Mxlnla  to  oon» 
Irlhuto  to  nisalon  auceass  e({uallir  with  aora  iMportant  iudulaa.  Tbia  la  aapoeially 
trua  If'an  uniaportant  aqnlpmnt  la  alao  eonplax*  '  Ifoelwiliic  avwh  aqulporata  would  . 
diatort  tha  allocation.  Tha  c'yndltlon  to  ba  nat  to  avoid  thla  la  praczaaljrt 

V.  ^  1»»  for  l*l^««*f  k» 

Any  equlpaent  for  which  thi'*  Inequality  falla  ahould  be  cllNlnated  from  the  allecao 
tlan  and  the  nodule  countj  an)  should  have  -its  nean  life  requirenent’ determined  in 
so;«  other  way. 

If  an  equipment  barely  nwete  the  above  inequcllty.  it  la  probably  better  to  uae 
the  allocation  formila  derived  without  the  approxiraliom:  ur'-l  in  the  preceding  se'  .ion, 
vix.f 

-t 

-  1  ■ 
logCi- i  d-p^i/')) 

V, 
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By  ttrlts  cxptnsloM  It  my  ahown  that  the  error  la  1/*!  ineurred.lijr  aalac  the 
ali^Xtr  allocation  forwala  as  opposed  to  the  exact  torMila  la  of  tha  order  of 

^  11^  (i  -1)(1-P)*  . 

^  ’*1 

In  sa'rty  of  flight  problensj  this  will  be  snail  becsose  1-P  is  very  c.asll*  In  alssloa 
Bucces.-  problea»>  it  trill  usually  be  snail  because  Oi^Aw^N)  X«  ■  ■ 

B  U  Allawanee  for  £olii-&taar  Electronics 
It  is  necessatry  to  tabs  account  of  the  fact  that  In  many  present  equipments 
functions  forrtbrly  performed -by  vecuun  tubes  are  now  done  by  solid>etate  devices*  For 
this  purpose  the  followine  aquivalenees  have  lean  adopted  in  cstklng  cp  a  nodule  ooantt  ' 

.  1  transistor  s  1  aodula  '  .  ^ 

1  diode  a  nidttle 
1  lugnetie  a.ipllfler  %  1  codule 

This  Is  not  Intended  to  nsan  that  the  failtee  rates  theviselves  are  rslat^  la 
tills  fashion*  natner  it  means  roughly  thatj  for  exanple^  a  transistor  and  Ita  associated 
parts  pwrforw  a  function  equivalent  to  one  perferaed  Iqr  a  vacttua  tube  and  its  associateif 


In  e  few  instances  digital  computeva  az-e  tneounternd  wltn  rather 
high  module  counta.  Reductions  In  aoduie  count  are  made  to  allow  for 
the  fact  that  failure  rates  per  part  In  dieital  eomputera  have  been 
found  to  be  far  lees  than  for  radio-radar  types. 

B  5  Allowance  Tor  I>.!pl3 cation 

In  case  an  equipment  ia  duplicated  In  parallel*  it  Is  necessary  to 
treat 'the  combination  aa  a  alngle  equipaenc  which  ia  then  allocated  a 
mean  life  as  such*  The  applicable  importence  factor  pertains -to  denial 
of  both  nemhers  of  the  combination.  There  are  two  problemsj 

(a)  What  Tiodule  count  is  used  for  the  combination? 

(b)  How  ia  the  mean  life  r  cf  each  fitesibex'  detcziulr.ftd  fr<jn' 
the  ftean  life  it  alloied  the  combination? 


The  eeoond  la  Atay.  We  have 

t  t  • 

«*P(-)  *  1  -  (1-  exp(-  -  ))2 

■  •  t 

^1  -  (-  S  )2  e*p(-  i*  ). 

which  can  be  shown  by  series  expansion  to  haire  an  error  of  ^he  order  of 
t3  ^  • 

-3(1-  -  ).  .This  error  Is  g.enerally  quite  saall.  Thus  • 

j* 

r  s^Bt/ ,  for  2  equlpmenta  In  parallel 
r  ,  for  3  equlpaenta  in  parallel 

The  solution  to  problem  (a)  above  la  not  as  clear.  Cbvloualy  the 
Bodule  count  used  as  Index- of  complexity  of  the  parallel  eoablnatloa 
should  be  less  than  that  of  a  single  aeaber*  -  If  .the  two  Bsabera  were  In 
series,  we  would  consider  the  combination  to  be  precisely  twice  as  eoa» 
plex  as  one  member.  Considering  parallel  connection  to  be.  dual  to  ;  . 

'series  connection,  we  therefore  use  half  the  tube  count  of  a  alnale 
member  as  the  tube  count  for  the  parallel  combination.  ■ ' 

Two  difference  equipments  . with  mddult  counts  /  n^  psrforalng  esssn* 
tlally  parallel  functions  should  be  treated' as  a  eombinatioo  wlth  tube 
count  l/>»(nin2).  •  ■ 

The  fonuls  sbove  should  then  be  reolaesd  with  - 


^  ^  V  “I.A  i*2  ■ 

rz  W  i  Vit5][5^  . 


The  nodUs-eount-  method  of  eceoontlng  for  relsti'rs  difficulty  of  sttaiiSMiit  Isstss 
r.arh  to  be  desired.  Progroee  here  should  SsVUrt  pmssrcss  lit  preuleiton.  JhiepUbUlty 
to  derstinj,  elr  oondllioning,  relaxed  tolerances,  tie,,  should  all  be  .oowldsred,  T^ 
oojeotlse  is  to  make  proper  sHovsnoe  for  pelstlTt  difficulty  of  sttelmetit  laheswrt  Is 
the  iuj.etion  of  the  eqvipnents,  idilch  asy  be  quite  di'ferenee  froc  relstl**  rellsblllty 
exhl'riied  ty  pe.ft  designs. 

The  lajdu'.e-coont  method  evsy  be  unfsi.*  in  thst  It  dlseriBln/tes  agsixct’ sumfeeturere  ' 
df»-r> loping  s  successor  oqulpufot  to  one  .vhich  hss  slres,-^  had  lie  tc'be  cotnt  reduced  as 
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e 

fltUlLt  of  th»  Am  WiftM  . 
e  1  S«l>jtlcn  of  Bi.idp«»nt« 

For  th«  kntf  phu*  of  tho  oomf  tiM  of  mro  ooloetod  for 

thiilr  intrinsie  iJ^MrUaeo  to  Ar^r  aporotlom*  Tho  type*  of  (onorellMd  •qalp* 
Miita  ooloetod 

(*)  Ttetieol  TtMeulor  coiMnieotloB  eoto^ 

(b)  Mobil*  loot  PUS*  ee«Baiic«tloa  Mt*^ 

(e)  Radio  rolay  ecaBooleatioa  Mta« 

( 1)  Mortar  I'lcatloc  radar  Mt*»  aod 
(*)  SAN  Cootrol  Battary. 

C  t  Celiac tlon  of  Pat* 

A  oriof  dlaeuasloo  of  the  pro^fu*  and  a  copy  of  tba  qaaatlonnalr*  var*-**^  * 
to  th*  proapoctlTo  plac«a  of  rlslts  prior  to  actual  poraonal  contact  by  tb* 

■cMbera  of  th*  taVc  groq^.  Reault*  for  each  typ*  Of  •qulpaeot  ar*  praaoated  1*  - 

labl#  c  I.  ■ 

C  3  Aralwl* 

C  3.1  Tactical  Tohicttlar  Ccarjnlcatlen  Sot* 

Ibo  replica'  are  presented  in  table  C  I  for  thla  cquipaent  with  the  reaultant 
wan  Ilf*  requircaeiiU. 

In  th*  dlacusslcn  uitn  paraennal,  it  wa*  clear  that  an  8  hour  shift  Mas  tb* 
crucial  period  of  tla*  for  vhlch  failur«>fr**  operation  la  raqulre-li  therefor*)  th* 
nesn  tlae  beteecn  failures  of  160  bcur*  vould  be  the  .IninuM  acceptable  for  the 
ueara  of  the  aeta. 

It  la  InteraatXnf  to  ncto  that  the  figure  of  .90  for  U!  ho-ura  la  not  con- 
aictent  with  the  requlrcfltnt  of  .95  for  6  hours.  ^  dlffcrar.ce  exhibited  her*  la 
these  reaponaaa  indici  tea  the  difficulty  In  CTaluating  rcMabiItty  requlreacnt*  and 


iim  graatMt  wrlaaea  U  mmUj  In  tta*  <ltt«r«laatloa  «r  tte  eritleal  parlad  U 
oparaiimu 

tmzci 


Kqulpnent  Tna 

Niaalon 

.length  . 

Mlnlana 

Aeeaptable 

SaUabDltr 

Miaa 

Ufa 

VetlcaZ  Tahieular 
woonusleatloa  lal 

(•) 

0  hours 

.95 

100 

(b) 

li0  boura 

.90 

ii0O 

Mobile  U>agltangs 
CoMBunieatioa  Set 

2ti  boors 

.95 

iiBO 

Sadie  Relay 
cation  Set 

Each  of  12  EqnipMaBta 

2li  hoon 

•90 

1,200 

IbiiiOO 

Mbrtar  locating 

Badar  Seta 

(a) 

ooa  bour  down  tina  S2 

23  .wary  2li  bra  tg> 

(b) 

2li  hours 

■  'ho 

(c) 

2lt  boura 

’  55 

UM> 

(d) 

20  days 

b,0OO 

(•) 

20  day* 

r»<oo 

iUi  Control  Battary 

(«) 

3^  i  »  t  -  .  r. '  -  »v 

!«0  hrs  39.1 

(b). 

I|6  In  }jpf  ^  t 

Iw 

-ry  li0  b6 

(c) 

6 

95 

120 

(d) 

2ii 

.95  . 

UO 

d  3.2  Fbblla  3anna  Coanunlcatlon  S«ta 

A  r^aponaa  for  the  raqulreaenta  for  this  aqulpwst  ia  (iron  in  fabla  C  Z. 
An  astlaeta  of  a  naan  tina  hatvaan  falluraa  for  this  ayaten  of  2i80  tiova  aaana  ’ 
quita  good. 

In  the  diecoseion  during  the  Intorriew  with  tha  werloua  groups  on  tMa  - 
equipnent  tjrpe;  it  was  quite  ocvious  th«v  the  voncept  of  rallabllltjr,  aa  wa  hawa 
defined  it  in  this  report,  was  not  -underetcod  adequately,  resulting  in  copeldar** 
able  difficulty  t.i  the  part  of  the  people  interrlnved  to  deteralne  a  probability 
flg>tre.  The  prlmry  retsoo  for  this  vas  that  tha  aystasa  vera  required  to  operate 
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contliwowly*  fii*  «  *btlmto  tht  aaftUtst  Uii(Ut  vt  Jm  tetNM* 


fjlilurvt  th«t  QM  b»  toItr«t«<l  for  953^  of  tte  foUmo*  poood.  Tbo  ro2oU«o 
li^p:>rUneo  of  this  sjvUa,  vlth  Mspsci  to  ths  MlatioB  aeeo^illsiwiat,  eeitld  w4 
bo  dotorolMd  bjr  ths  uttro.  tU  vsrioao  slUraoUvo  toehaiquoo  or 

swdo  tbs  l^porUot  fsetor*  m  tissd  In  this  npert.  rolotmiy  snsU.  Iuleslljr» 
tha  assr  ntroljr  ststsd  .that  fallsra  of  aogr  partiealar  aqulpasiit  radoead  tha  affM* 
tlTonsss  of  tbs  opsratlos  (nllltarjr)  but  It  was  l^posslbls  to  dstsralBO  vhst  ofibet 
this  nlxht  hava  on  nlsalon  fslKe** 

lbs  radio  rolsf  sets  srs  continuous  opsrstlat  oqnipiisnts  ussd'prinariljr  for. . 
eoanunlcations-  bstMosn  Aralas  or  snonc  imlss.  A  eeaMBiastioos  nstuork  of  thass  . 
squipnants  gsnsrsUjr  eonslsts  of  two  tsrainsl  otstloos  and  firs  roUf  stottons* 

Saeh  tarjdital  station  consists  of  ons  rsealver  transalttsr  And  aacb  rolsf  'ststioa 
consists  of  two.racolror  tnuwntttsrs*  A  spars  rscolvsr  transnittor  is  naiaUinsd 
St  asch  location*  lbs  qnssticaa  diroetad  at  tbs  ntors  of  thass  rjwtons  apply  to  an 
antlrs  rslajr  sTOtan  coaslstiac  of  12  roSslvar  traaanittato'  in  nss  with  6  standby 
spars  RA's*  It  is  kiMim  to  taka  approxlnaloly  firs  nlniitss  to  switch  a  ^ro  unit 
into  oparatlni  position  whan  a  fsilto*  oecirs.  Tfco  rtplias  to  tbs  quastions  (so# 
Tabla  C  1}  havw  Indicated  thst  tbo  ninlnon  tins  betwacn  fsilurss  for  99f  of  tbs 
ftiluras  should  bo  2U  boirs  for  tbs  systen.  Also,  that  $0d  of  tbs  repairs  aboold 
bo  nads  in  Isos  than  It  boors*  This  cenaoponds  to  a  aoan  tint  to  fsilurs  for  tbs 
s>st«B  is  1200  hours  and  tha  won  tint  of  fsilurs  for  a  sln(ls  reeslesr  trsnsntttsr 
la  lit,l(00  hours  and  n  naan  tins  for  ropnir  of  ono  hear. 

A  raaponse  of  96f  of  the  failures  haelng  a  tins  bttveon  fsilurs  of  2it  hours 
or  ners,  aeons  that  out  of  a  100  day  period  3f  operation  only  two  days  would  bo 
oxpectad  to  havo  a  failure  and  98  days  can  bo  oxpacted  to  bo  fctlure  frao,  Ibia 
ficuro  appoaro  to  ba  Tory  high  and  it  la  tha  co.-wansua  of  opinion  that  a  responss 
that  cf  the  failurot  haring  a  tint  batwean  failure  graater  than  2i  hours  would 
ba  nora  raaeonablet  This  would  corraapond  to  a  naan  tine  to  failuro  for  a  sl^le 
recelrer-tranenlttar  of  ?6CX)  hours. 


6a 


j  v.'u  rtrw  vxt  i 


» twerbA  rJtrtM 


®  tbrUr  Loftlat  tMv  8«t» 

4ar«nttT»  nite  mU  ar*  4m«4  pelauilgr  tor  lacatlai  artlUnr  « 
aortar  laataUatioaa.  tc  napoua  ta  atr  qaattiafnalNj  tte  pacpla  Sstarrlaaad 
iodleatad  that  thia  equi;>a*nt  atr  ha  aaad  oejolmro  from  taa  4a?t  ta  taraat/  dija  far 
a  ala(la  aiasioii.  Tht  oparatioa,  aurln(  thia  tSooian,  «aiil4  ha  caatlaaoaa*  Tha 
man  Inlieatad  that  to  failuraa  ahauid  aeesr  Artef  thia  eaatlaaoaa  partad*  dftar 
aa«a  dlaenaalon,  it  vaa  raallaad  t*Mt  tha  tatcraaea  af  na  failuraa  waa  iii^alhla* 

A  ravlaad  aatlaate  (taa  fabla  C  X)  wa  ahtaiatd  la  whieh  tha  war  ceneladad  ttet 
90  -  9S%  af  the  3li  hour  periods- ahemld  ha  failam  Area*  Ta  additfaa^  it  vaa 
iadlcatad  that  JO  mcistea  could  ha  vead  for  rapclr  or  praawMn  wlrtamnca  as 
aadi  dap  hatMoa  siaaloas.  fiigiMerlnK  panoBBal  iadieatad  that  tha  apaeifleattor 
ratpiiraa  tha  oquipwat  to  oparau  2J  out  af  21i  hatn  and  tha  athar  hiov  vaa  to  ha 
naad  far  raptlr*  The  repair  tlaa  of  ova  hour  eaaid  taka  vXaea  at  aep  tlM  vhes  a 
faiiarc  aceora  and  it  iai^t  tr?  tha  total  tiai  ta  vaka  a  mater  af.rapalra. 

Xf  va  atillsa  tha  9Sf  rattnirawot  A>r  tha  2h  haw  pttSoda  of  fhilvniaAraa 
aparatioa,  va  would  impcoo  a  raquiramat  af  bSO  houra  hateeca  faUurat»  *  2t  ia  tha 
cosaaaeaa  af  opinion  aiKoc  tha  taak  group  that  tha  fvqatramet  af  183  hewa  ufouli 
appear  to  ha  a  raaeonahla  ra^oiranaat* 

C  3,5  9Mf  Control  Battery 

four  aeparate  croupe  vara  eontartad  for  tha  raquiranasta  for  tha  dafoMiva 
ataalla  ground  apston.  Zt  va«  clear  that  with  tha  dafanaiva  adaalon  of  thia  apata* 
no  adninoB  roquiraaant#  cc-Ud  ha  aUtad-without  vow  aonaidaratien  af  tha  doata. 

It  vu  auggaatad  Uyit  it  would  ho  nacoaearp  to  apaclfp  tbo  foUoviag  CDaditiooet 
(a)  esrlp  varnine  tiaa, 

(hi  leval  of  oxpeetM  attack| 

(c)  IcTfl  of  defense  (doplepMfnt)^ 

(d)  aneiqr  repoMlitieaj 
(o)  tTpea  of  defonee,  and 

'!)  treak-'tlirs;^h  tT-at  can  he  tolerctod. 

Since  tViae  condlilcas  ccjid  iv)t  be  soecifiod  with  anp  degree  of  acccrasp) 
tz9  official  poaiVos  tacts  bp  wet  people  in>ralswed  waa  that  no  failurea  of  tha 
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•iMtroAle  •jraUa  eoulil  %•  tol*r«t«d.  lUt^tlm  U«t  Uiii  a  raylwat  t»e 

tte  atiilnM  acMpUbl*  raUablUiy  oT  1.00  aad  titit  thi«  fir**  i»  U^oaalUa,  «Uw 

appreaete*  imt*  BKMMuy.  is  «  rMult,  *r«MMaUs*  rs^alrMsets  In  ll|»t  «f  tte 
-lidivldusX’s  tamrlsdc*  of  tte  oxlstlflc  spston  «ni  Mn  oxpoctarf-i—  $7  tte  29<S0‘s 
tMr*  oUslasi  la  tv»  cssoa  «m  la  snotter  too  easos  tte  aarl;  ’■***•< "f  porlod  «m 
spaelflad. 

Yte  fl(»«a  praaontad  Ir.  tatla  g  i  tji  forast  (a)  tte  first  tso 

insteartes  wart  In  tte  font  of  tte  ihabar  cf  tears  of  MlnUoura  ttet  shMU  te  . 
r*<tiilr«l  for  aiqr  raaioaljr  aalectad  porlod  of  t  tears  sUko  ti:!a  aa««»d  to  te  tte 
oaalaat  Mthod  of  attack  ly  'tte  opsratloaal  pacpla;  (b)  tte  latter  tso  rssparsos 
sUtad  tte  MiptlrsMat  ttet  only  p  poKsut  of  tte  tias  tetma  faUvw  conld  te 
teas  tten  t  hotav  and  apaelflad  an  atert  atatoa  steroty  tte  aarly  aarolat  sosld  te 
oos'half  tew. 

It  te  etear  froa  Ite  data  la  MblaC  X  that  tte  addiilta  of  tte  isatrletlo* 
of  an  oarly  saralac  tins  ersatad  aa  additional  coorldaratjca.  C<»«;te3t2y  0  roonlt 
vao  darivad  diffmnt  IVca  tte  otters.  I»  eorrset  or  aloolata  ranlto  caa  te  dotor* 
alnad  froo  tteao  rospoo»a>«  tet  It  la  tte  constwas  of  oplalcsa  cf  tte  (roap  ttet  a. 
idnlAta  oceaptabte  flfvro  of  1|6  btme»  SMa  tias  tetsssa  faCwa  ocnld  te  appreprlato 
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apOMidlc.  ««Ui*  6U.nfi^  iBfoi-ttoi,  «<!  *r.  Pttbll.i.,d  tn  . 
dO€w«it  «•  B  ittj>pl«Mini  to  thl«  roport. 
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•Uetronie  •/■tta  could  te  toX«r«Ud*  lU«llsla<  ttet  this  ploeod  «  ro^ulroMRt  tw 
U»  RtnljRUi  oecopUklo  roXlcblUty  of  1,00  tod  tlitt  this  ta  ii^tlUty  otbir 

approtehta  tiara  Baeaaaarjr.  Aa  a  raattlt^  "raaaoMUa”  ra<ittlrawoU  in  ll«|ht  ot  tha 
indlTldutl’a  knoaladca  ot  tba  axlatlog  aya.taa  tod  hla  aipaeUMooo  bgr  tba  IpM't 
Mara  obbtlnad  la  tuo  ettat  and  ta  atiothar  two  caaaa  tha  atrljr  Mtniliic  parlpd  mu 
r^lttad, 

Tha  flctiraa  praaaatad  Ir.  tabla  ^  X  war;i  in  tarjlng  feraii  (a)  tha  tint  tuo 
toattneOB  vara  la  tha  fern  of  tha  nuahar  ot  huura  of  ptiatantnea  that  thettld  ba 
raqutrad  for  tiqr  raadontjr  aalMtad  parted  of  t  hotara  alnea  thta  aaanad  to  ba  tha 
eaalatt  nathod  of  attack  bjr  tha  opartitonal  paoplot  (b)  tha  lattar  tba  raapooaaa 
atatad  tha  racfutraiwnt  that  onljr  p  pareeat  of  tha  tt<i«  oatwaaB  failuraa  could  ba 
lata  than  t  ham  tad  apacifiad  an  alari  atatua  vfaarabjr  tha  aarljr  vamln(  Mould  ba 
ooa-htlf  h»r*.  •  •  ' 

It  ta  claar  fron  the  data  In  tabla  C  X  that  tba  addition  of  thp  raatrietibn 
of  an  atrip  vamlnc  ttna  craatad  an  additional  eonaidarttioa.  Cooaaquantlp  a  ratuli 
Mat  darirad  dlffai-ant  from  tha  othara,  Ko  eorract  or  abaolsta  raa'ulta  can  ba  datar* 
nlned'fren  tbaaa  raaponaaaf  but  it  ia  tha,  eonaaneoa  of  opinion  of  the  group  that  «. 
adnimi  aecaptabla  flcura  of  U6  boura  naan  tint  batMaan  failnrat  Mould  ,  ba  approprlaia* 
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APPfMOn  f 

A  SlBpl«  Coat  Model  for  Optlmltlnc  Reliability 
by  R.  R.  Carhart  and  o«  R>  Herd 

A  simple  oost  model  is  utilized  to  describe  means  of  Allo3«tln< 
expenditures  between  development  and  operating  reiulreMenta  by 
selecting  that  reliability  whlcb  will  mlnlulze  total  cost.  Xt 
Is  Intended-  to  be  a  quick  and  flexible  means  of  establishing, 
approxlnece  cost  alloeatlcn  between  requirements  which  are  functions 
.  of  reliar  u  ey.  The  emphasis  of  this  psper  Is  on  a  methodology 
rather  than  on  specific  dollar  values  to  gilds  the  potsntlsl 
user  on.  the  amount  of  monetary  smphssls  that  should  bs  given  to 
the  problems  of  reliability.  .  j 

r  1  Introduction 

Although  s  pert  of  a  cost-sfislysis  task  la  simply  to  dstermlns  ths 
cost  of  producing  and  using  a  system,  a  more  important  aspect  of  the  work 
is  tc  establish  the  costs  in  a  way  that  will  permit  Judgment  regarding 
certain  significant  features  for  budgeting.  This  consideration  ties  lad 
the  authors  to  the  method  presented  herelh  -for  alloostlng  the  budgetery 
resources  between  developmental  .and  operational  rsquirsswi.ts. ' 

The  two  major  cost  categories  that  are  oonsldered'  are:  (a)  dt> 
velopmentsl  costs  and  (b)  operational  costs.  The  ass  of  only,  two  broad 
categories  mesns  that  a  multitude  of  factors  are  included  within  each  ■ 
cacegory  so  that  in  the  future  It  Is  essential  that  more  refined  costing 
should  be  used.  However  this  simple  breakdown  doea  emphaslca  clearly 
the  contract  of  the  one'-tlme  investment  outlaya  by  R  A  0  agalnat  the 
Invsstment  and  recurring  operating  expensss  of  the  procurement  and  main¬ 
tenance  groups.  This  distinction  will  permit  a  better  measurement  of 
both  the  eco.-.omic  Impact  in  terms  of  R  A  costs  against  the  total  cost 
of  the  operation  o/er  the  expected  useful  life  of  the  syatems.  (Rand 
has  developed  a  methodology  for  coat  estlssting  which  may  be  adaptable 
to  th'.B  sit.'stlcr.  --  see  Coseent  (h)  at  the  end). 


-srjr.-  »^:^^s»^:-^•^ar  !*vtirjaKJ«v-iire  cjirib*s«i«ac^J^^ 


On#  wity  to  define  the  optisb*  reliability  for  •  pleet.ef  eleetronle 
equipment  le  to  eeck  thet  value  of  the  reliability  vhleh  slnlalxea  total 
mlsalon  eoat.  For  bovbinc  radar,  for  example,  the  aiaaloe  mlfht  be  to 
bomb  a  abated  number  <'f  targeta  whec  required.  The  cost  to  maintain  thla 
oapablllty,  aay  for  one  year,  mill  be  called  the  total  mdailon  eoat, 

tt  inoludea  the  eoat  of  hai-dware  development,  faexlltlea,  aircraft, 
Bupplleej  training,  etc.  >  everything  neceatary  to  catebUah  and  main* 
tain  the  military  capability. 

F  2  The  Coat  Fodel 

The  mlaaion  coat  la  the  eua  of  the  'operational  cost  and  develop* 
nent  coat 

C««C;,tCB.  (1)  . 

The  basic  coat.  C  •  conalats  of  a  "basic*  eoat,  Ce,  which  la  Independent 
of  force  else  and  the  reliability  plus  a  vairlabla  cost.  C^*  which  la  de*- 
pendent  tpon  the  "force"  coat  and  reliability  ao  that 

Cq  •  Cg  +  Cj»  ,  .  (^) 

Tne  baalc  coat,  Cp*  since  it  la  independent  of  the  reliability,  of  tha 
electronic  equipment  and  tne  number  of  equipments  must  include  aueh  coats 
aa  baelc  Installation  facllltlea,  services,  admlnlatrauon,  etc.  This 
basic  coat  Includes  costa  of  an  Inveeiaent  nature  as  well  as  of  a  rt* 
currlnj  nature.  The  variable  coat,  C_,  reflects  the  coat  cf  thoae 
Itetoa,  facilities,  and  cersonnel  *lch  must  be  Increaeed  if  the  reli¬ 
ability  la  low  In  order  to  sralntaln  a  cevtmin  capability.  It  seema 
reasonable  to  assume  that  thtre  is  a  'force*  coat,  Cy»  necessary  if  tha 
equipment  rellabllfty  for  a  t  hours  were  unity  and  that  this  Tj  would 
change  Inversely  wit,*'  the  rellsUllty,  l,e., 

Cb  ‘  Cp/'J,  (3) 

where  K  Is  the  missiv’'.  reliability. 

For  sn  equipment  reliaollity  o!  =0%  (R  -  1/2),  twice  ti.e  lorce 
size  Is  needed  because  .■'.air  t-.f  missions  will  fell;  hence,  c;st  la 
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.q»tM»M  for  rai.h  „„  opuM„jj„  „  p„,p^  ^  ^ 

~ltmu»  ^  „,  ^ 

MMillt,  t„U.l  .,  p„..„,  d,„„p-«M 

Cl  for  Ciiltllw  »•  citTM  b„0«l  th.  noM,»i  „„  i„ 

Of  m.  t«l.  c.„  t,  i.  c,^.  „».  V  ».  C  -.tonOC  c«t  «  «.  . 
Cop  .  ,J,.„  p„.  p,  CUWU-p 

If  .  0..  .,„lp,.„,  i.  pp  ««-tl«.,..,.„„  P.  ■ 

M»  w  ti.„  thit  .r  ,  ppp„„,  „p.p«„,,  pppp  .  10  c  c  .aod Jd 

O.Cop»«  ....  c,^  ,111  1.  1„P„.,«  p,  .  fppppp 

.Ohio,.  C  „,.i„d  Mdlu.p.1  ppiippiiip,;  ...  ^ 

Wiil«h  must  be  fietermlned  from  emplricrnl  studi**. 

y-3  Cytglexity 
TO.  r.U.MU.1  of  p  „pip„„, 

00, 1..  («.,  pppppp..p„  .,  .„a.„„.,  „ 

«  I.  C  OCMlli,  pf  _„p  ppiip...  IP  pppppp^p^  p 

assumption 

R  m  e-tA  •  e-nt/r 

where  a  -  equlnment  mean-time-to-fsi?--®.  a  fon.t.  . 

went,  failure)  i— re,  a  constant  (houre  per  equip- 

n  -  number  of  mocules.  a  aeaaur*  of  complexity  * 

T  =  module  aean-tlrae-to-fallure,  ’  *  ’ 

Th.  »,o..l,  1.  .  ppppppp  .„pp,  pp  p,„.i„i,p,  ppp^_  ,  p  pppppppppp 
on.  .l.«roM,  ipuoip,  pcq.  fpp  rKUmiW  sc  . 

WC  0.01.  Of  „c  h..  p„  ...pp„p  ppp.  ppp  ppp^^ 

port..  B,  d.fl„l„s  Ih.  OO0.1.  „  i/;.  ,f  p,  pPppp^p^^ 

.  n».bor  Of  K,j„i„  ippp„p  .ppp„.„.pi,  ppp  pppppp  PP  PPP^_^ 

If  th.  Cl.  „„.i..„ii,pp.  p.  ,  pppp._  p^p  PP  __ 

oCduIcs  In  an  <fQulDn«*nt«  irith  s 

,  '■•"  ■'““•'I'OllT  lno.p.M.,„.  IP. 

equipment  mean  tlce-to-failure  Is  n  -  -/f  ThUtn  -k  ,  , 

./...  Ttiia  Is  Shown  in  (7), 

*rrer3~S,H,,  ani  Hetlctnf ..ib< 

BojiS?";  r'-'""‘;-,-  »'i»on»T  of 


T  ’«.X  ^ 


■  y  ,3''-  V  I 


I-,''  '•  V  ',1  •/' 

Iv’  ,  '«.'<■•'  ?'■•' 

liri-y.'-;:.-'".}-'- .‘ ■ 
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■odul«  concept  alloMs  the  eoaplexlty  fectoi*  to  be  removed  In  compering 


equipments  of  different  complexity  In  reliability  cone'ideratione.^ 
Prom  (7)  T  can  toe  expressed  in  terms  of  R  so 

T  *  -nt/log  R  (8) 


where  log  R  is  the  natural  logarithm  of  R. 


Upon  substitution  in  (6}  we  have 

Cn  •  Cw  ♦  d(-n;/logeR)*.  (9) 


where  d  =  Cfj  /Tq®  and  the  sileslon  cost  given  by  (1)  becomes 
°  C-  =  C3  t  CpA  >  Cb  +  Cr  (10) 


“  Cg  t  CpA  t  Cjj  ♦  d  (-nt/log  R)  , 


F  4  The  optimum  Reliability 


The  mission  cost  (total  coat  per  mission)  is  given  In. terms  of  the 


•  -reliability  In  (10)  and  io  minimize  this  cost  C^,  with 'respect  to  R  is 


to  make 


but  this.. Is  equivalent  to 


or  from  (10)  with  some  manipulations  we  have 


S  s  ~ad(.nt)* 


B(log  R)* 


Rearrangement  gives  the  condition  for  optimum  reliability,  say  ](,  as 

.He 


(log  sd(  nt)*  • 

(14) 

{i^J  •  id(Hty» ' 


For  given  Co#  *5*  ®  nt  this  equation  can  be  solved  for  TJ, 


F  5  An  Approximation  for  optimum  Solution 


For  the  exponential  law  the  u:'xeli*h1 1 )  v.y  is  defined  by 

Q  -  1-R  -  l-e'f»tA  .  (15) 

'When  Q  is  small  compared  to  unity  the  following  approximation  holds 

Q  •  ntA  (16) 


«  .  -  ' 


I'd"..?*'  V'''. 


'•'In  ^  . 


This  approxlskstlon  la  quite  good  for  R  as  Ion  aa  .70  oi*  Q.v  .30. 

?or  a  particular  place  of  equlpoant  in  Mhleh  the  product  "nt*-  la 
fixed,  the  reliability  coat,  C]{,.  can  be  axpreaaed  Interna  of  tha  0., 
The  (6)  nay  be  Hrlttan  at 

‘'B*®Ro^)  '{\7) 

tha  approxluatlon 

-  log  TT  •  -log  (l-5)f»5j  (?«1)  (18) 

In  (IS)  we  obtain  the  relatlonehlp 

(19) 

KoN  Qg  Should  be  In  the  neighborhood  of  ^  so 

(l-<3,)CRyCy 

■  5  .  (20)  .  . 


rrr  .  (20)  .  . 


P  6  Nunerlcal  Exenplea 

TO  llluetrate  the  remarkable  eevlng>  In  the  force  procureaent  pro¬ 
gram  which  can  be  effected  by  reliability  development ' effort,  abae’ax-- 
.  amplea  are  given  utllixlng  (20)  for  determining  the  optimum  r*ellabillty. 
It  la  believed  that  the  coat  numbers  used  are  correct  within  an  order  of 
magnitude.  The  reliability  figures  are  aeauned  for  llluatrst  .on  pur- 
poaea  and  the  approach  presented  aesuoed  that  the  Importance  factor  for 
the  system  under  consideration  la  one  In  each  ease,  ,  The  assumption  of 
an  importance  factor  different  from  unity  will  not  change, the  analyala 
althoug.h  the  reliability,  Rg,  will  be  affected  and  a  different  optimum  , 
point,  TJ,  will  be  obtained.  The  results  she  that  the  optimum  rel.l- 
abllltles  for  typical  airborne  complex  electronic  equipment  a'*e  ex¬ 
tremely  high  according  to  our  argume.nt  presented  eerller  In  the  paper. 
This  means  that  we  are  falling  far  short  of  ope.-idlng  enough  to  develop 
rellAblUty  far  too  much  money  is  spent  on  buying  additional  forces 
to  sopple.m'.'nt  Che  unrcllabie  ones  through  redundancy-. 


'  H-.V 

's.  «  ‘  ' 

teisi 


i^rt^-’T.i^«a\jg^3CTgiyjfc:^3aaragijiMuifaKj««-a2Fa!arasiB^  AtfUEgaeg 


Xn  the  following  extinples  we  shell  atsuae  •  alsslon  force  of  one 
hundred  bonders  coating  about  lO-sllllon  dollars  *  place.  (This  is 
about  equal  the  present  cost  of  8-32**  olth  aooe  support  cost  ln> 
eluded*)  In  other  werds  force  cost,  Cy.  for  the  100  bombers  will  be 
proportional  to  |109*  one  billion  dollars,  ^e  proportionality  factor 
Is  to  express  Cp  on  a  per  mission  basis.  It  Is-  further  assumed  that  . 
the  mission  Is  to  provide ' Immediate  retaliation  If  called  upon  over  a  - 
one'>year  period  of  time  and.  that  the  aircraft  and  equipment  useful  life 
are  the  seme  .-o  that  the  proportionality  factors  cancel  out  In  the  rs>- 
sulting  examples. 

Example  I 1 

Suppose  we  have  a  transceiver  communication  equipment  similar  to, 
say*  the  ARC-27  or  ARC-3^.  The  following  Information  .'.a  avallablat 


20  hours 


$250,000 


Cp  =  $1,000,000 

T©  *  10,000  hours  ■ 

Ro  •  .80  «  1  -  Qo 


(a)  If  reliability  Improvement  cost  is  Indirectly  proportional  to 
the  decrease  In  unreJlsblllty  l.e.  In  (17)  a  •  1  then  from  (20) 
we  find 

1  -  If  •  5  "OV.So)  250,000  .  ;oo63 
\|  109  •  . 

■^o  the  optimum  reliability  is  given  by 

IT  •  .9937 

(b)  If  a  •  2  in  (20)  we  have  •  ' 


5*3  f2[,Z}'-(.6c)  250,000  -  .0252 


K  *  .977 


iLtatMMtmjnLitXM  t_v»  -h.  •  >  PMVjinMK.-n  u-rm-i’  irw^w.em^ 


Suppose  we  have  a  bombing  -  navigr Clonal  equipment  and  the  follewing 
information  were  available: 


n  • 

500 

s  - 

tio.oco.ooo 

t  • 

10  hours 

Ro  - 

.9  -  1  -  Qo 

Cn  r 
"o 

^£,500,000 

To  - 

50,000  hours 

(a)  If  as  1  in, (20)  we  have 

ir  -  *  innnsnEK^-  .6150 

V  109 

■ff  *  .9850 

(b)  If  a  •  2  In  (20)  w«  have 

5 


•  1  /2( ♦1)^(  9)  £5  X  10^  «  .0356 
N  io9 


Tf  -  .964*  . 


**  7  Coaaenta 

(a)  .The  model  takes  Into  arrount  oonplexltj  and  operating  time, 
forae  ooatt  the  atate-of-art  of  elaotronlo  rellabllltjr. 

(b)  It  does  not  Incl'i'de  the  "5^"t"  of  larger  development  time  for  . 
higher  reliability  (If  i' 

(c)  The  development  coat  function  (5,  6)  la  an  arbitrary  function 
but  It  la  e  reasonable  function  to  assume  for  empirical  evaluation.  At 
this  time  determining  the  eonatanta  a  end  b  la  difficult  beceuat  of  the 
limited  Amount  of  data  available  on  how  much  it  coats  to  Incrcaaa  rall- 
ablllty  by  kno'm  amounts.  Howovcr,  aome  rough  eatlmstes  could  be  made., 

(d)  The  reasoning  employee  herein  la  perfectly  general  and  can  be 
applied  to  ae’/eral  different  equlpmenta  Independently. 

(e)  The  model  tends  t  give  conaervatlve  results,  l.e.  the  optimum 
icllsbUitlea  should  be  even  higher  than  those  given  by  (14)  and  (20). 
one  reason  for, thla  la  that  the  wholi  atite-o^-art  In  reliability  tjnds 
to  be  advanced  o’-er  a  breed  front  by  Improv.  v..  jta  made  In  one  aecter 


(tub»>o,  parte,  Inatallatlcn,  operational  case,  etc.}. 


Other  equlpmenta 


ean  thartfor*  b«  inproTad  in  reliability  At  leei  eo«t.  Thue,  there  any 
be  A  treaendoui  *ahere  the  profits*  effect  when  developsent  noney  is  In- 
eceted  to  inqtrove  electronic  rellsbillty  on  even  one  project.  Per  this 
*shsre  the  profit*  effect  to  be  reelised  It  is  of  course  necesesry  that 
there  be  sde4uste  teohnicsl  eoennunlestion  about  th«  reliability  !■> 
provecenta  in  queation. 

(f)'  It  is  well  known  that  a  number  of  major  electronic  projects 
have,  during  recent  yeera,  produced  equipment  of  unacceptably  low  reli> 
ability.  In  some  of  these  projects  major  ad  hoe  "fix-it*  programs 
have  been  initiated  to  improve  the  reliability  of  the  production  ar> 
tides  to  a  point  where  the  services  could  use  them.  It  ia  believed 
by  the  authors  that  attaining  reliability,  by  such  ad  hoe  means  ia  very 
much  more  costly  than  the  expenditures  required  ^  the  development 
program  to  obtain  the  sane  reliability  in  the  end  product  through  a 
well  organized  and  well  planned  program.  In  obtaining  any  numerical 
data  to  project  the  reaulte  of  this  paper*  therefore*  only  development 
program' costs  and  resulting  reliabilities  should  be  considered.  If  the 
evidence  from  the  ad  hoe  programs  are  used  to  furnish  examples  the  rell' 
ability  Will  appear  to  be  much  more  costly  than  it  in  fact  la  and  the 
optimum  reliability  will,  therefore,  appear  to  be  lower  t^han  it  actually 
la. 

(s)  Definition  of  State-uf-Art.  In  connection  with  (6)  it-  was 
t.uggcsted  that  the  module  oesn'-time-to-fallure  T  be  used  as  an  index  of 
the  reliability  State-of-Art.  In  applying  this  in  practical  studies* 
it  is  believed  that  the  upper  20  percentile. point,  Tg,  in  the  distri¬ 
bution  of  T  should  be  used.  That  ia,  20^  of  the  equipments  chosen  as 
representative  for  eatabllshlng  the  state-or-art  should  have-T't  greater 
than  Tq  and  805»  should  have  T'a  which  are  lower  than  Such  a  sam¬ 
ple  should,  of  course,  be  subject  to  some  constancy  in  the  factors 
which  affect  reliability,  such  ae  Inatallatlon,  maintenance,  etc.* 

irs  1  Guide  for  Techalcai  Repcrtl-»g  of  Electronic  Systems 
.heiicblUty  Keasvreiients,"  RETKA  Systems  ReUacliity  Analysis 
'^asK  croup, 
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I 


Id 


Not*  that  the  eouplexity  n  and  the  operating  tloe  t  need  not  be  the  aacc 


In  order  to  compare  the  module  mean  tlne>to-fallura  for  two  different 


equlpmenta . 


(h)  In  analyzing  force  ecata  Including  aupport  eoata,  it  la  be¬ 
lieved  that. the  techniques  of  coat  allocation  developed  by  the  Rand 
Corporation  are  appropriate.  A  suitable  reference  dealing  with  this 


problem  la: 


David  Kovlcy,  "Weapon  System  Cost  Methodology^" 
sand  R-287*  1  February  1956. 
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SCOPE 


Th»  CTlflslon  MSlgued  to  Task  Group  Two  by  OA5D  is  as  fol¬ 
lows:  ’’Develop  basic  requlremenle  for  te^ts  to  be  accomplished 
on  development  models  which  will  prove  that  the  design  is  cap^le 
of  meetlng'thc  minimum  acceptability  figure  for  reii^ility  estab¬ 
lished  for  the  equipment  type.  These  tests  filjsdl  be  designed  to 
be  performed  cltnerln  addition  to,  or  in  conjunction  with,  what¬ 
ever  performance  evaluations  are  specified  tor  the  equipment." 

In  establiahlng  the  scope  of  the  Group's  interests,  it  is  uss- 
ful  tu  relate  the  mission  as  stated  above  to  the  various  phases  of 
an  cqiJpment  prt^ram.  These,  as  usually  practiced  by  contract¬ 
ors  fer  mlUtar}'  electronic  equipment,  are  listed  below: 

(1)  Feasibility  determination. 

(2)  Fabrication  of  one  or  more  development  models  to 

demonstrate  compliance  with  specified  perform¬ 
ance  requireinents.  Assuming  satisfactory  results 
to  this  stage,  appropriate  DOD  agencies  determine  ■ 
Yheiher  or  not  to  proceed  through  the  following 
phas..'S:  ■  • 

(3)  Pilot  production  of  one  or  more  preproducUon  models. 

('»)  Production  in  quantity  for  military  use. 

(5)  Release  to  the  usings  servlcea.  ^ 

The  e/foids  of  Task  Group  Two  are  concerned  with  phase  (2) 
above  and  with  the  method  of  arrlvir.g  at  the  subsequent  decision 
as  to  ws.ether  ur  not  to  proceed  to  phase  (3)  from  the  standpoint 
of  reilabiiity.  It  also  Ic  consider^  by  the  Task  Group  that  in 
formation  deve’opcd  In  phase  (1)  above,  and  pertinent  to  the  as- 
eessmert  of  reliability,  is  within, the  scope  of  the  Group's  inter¬ 
est. 

The  m'lsslon  as  stated  above  emphasizes  the  need  for  a  reli¬ 
ability  "fl:r>»re".  However,  In  arriving  at  the  technical  require¬ 
ments  for  a  rrliabllUy  test,  the  Group  discussed  many  other  re¬ 
lated  pr'-a-s  ard  carat  to  the  conclns'on  that  the  following  object-  . 
ives  are  also  jegiUxuately  witliin  the  scope  of  the  Group: 

(1)  Fiecoran)rnd,;uons  for  reliability  evaluation  means  other 
th'in  rel'.abllity  tests. 

(2)  Rscommendatlofj  to  Improve  Ute  validity  of  reliability 
evaiuacton. 

(3)  Recora;ncr,'J3.tlon:i  for  means  of  rellsbtlily  improvement 
cc.areclfjd  with  reliability  tests- 

WhiJe  no:  slricUy  -ft-ithin  the  scope  of  Ihl.*;  Task  Ciuup's  rats- 
b:o.”.,  aev(!>-ii  C'’'i).;nent3  are  presented  in  Section  C.O  wilh  regard 
to  prcetni  procurement  pracilcea, 
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2.0  RELlABIIiTY  EVALUATION 

The  mission  assigned  to  the  Task  G;oup  is  essentially  a  re> 
quest  to  develop  eval'iailon  meaiks  to  give  a:S8urance  that  unreli- 
abls  eoulpmept  ^?iil  not  be  released  for  pilot,  or  perhaps,  rro- 
ducuon  runs.  Several  methods  have  been  suggested  lot  evaluation 
of  equipment  reliability,  among  which  are: 

(1)  Equipment  failure  rate  tested 

(2)  Reliability  prediction  based  on  review  of  paper  design. 

(3)  Review  of  the  contractor's  component  test  h*  failure 
effort. 

These  methcds  will  be  discussed  briefly  prior  to  precenting 
the  Task  Group's  recommendations. 


This  test  is  based  Oil  observing  the  failures  occurring  on  one 
or  more  sample  equipments  during  extended  life  test.  These  life 
tests  may  be  run  under  environmental  conditions- Intended  to  ap¬ 
proximate  those  encountered  in  service  use. 

It  ‘e  generally  asoumed  by  those  working  with  this  type  of  teat 
tliat  the  failure  rate  for  present  electronic,  e^pment  follows  some 
such  curve  as  shown  below: 


Figure  1 

It  lij  3S5vr)>vl  'hat  the  life  tests  are  conducted  during  the 
"chsjice  failure"  period  in  which  the  averub'e  failure  rate  is  gen¬ 
erally  c(  .-istant,  with  "tlaie  belwcen  fallurrs"  following  an 
e-voneiitlal  distribution.  Unoer  th!n  csoumptlon  ti,®  failure  rate 
IB  caiculAted  as  the  number  of  failures  per  unit  lime  for  a  single 
emilprr.ent;  Uif  h-.-srst-  01  ihe  fsUure  rate,  or  mean  time  between 
failures,  is  also  u£cd  to  expresB  a  fljnire  of  merit  for  the  equlp- 
Dioju.  Further  discourse  on  the  ii-athcmatics  of  this  type  test 
and  acconiFanjd'ig  assumptions  wUl  not  be  attempled  h<-r3  since 
this  subject  hr-s  iK-en  adequ.itcly  covered  in  the  llft/alare  by  many 
wurkerH  (see  F.'bllcgrrphy)., 
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Retaining  the  above  an^umptlon  with  reganl  to  failure  dletri- 
bution,  the  limits  within  which  the  failt  re  rate  of  the  total  equip* 
Blent  ^pulatton  can  be  stated  to  lie  lor  ft  ((«ve.i  eonfi  ience  level 
depends  upon  Uie  number  of  failures  experienced.  For  example, 
ll  has  been  calculaled^at  if  19  fallarca  are  experienced,  one 
may  state  with  a  confidence  of  00%  ISiut  the  true  failure  rale  lies 
within  *40%  of  the  calculated  failure  rate;  if  08  failures  are  ex¬ 
perienced,  these  limits  may  be  reduced  to  20%,  These  failures 
may  presumably  be  accumulated  from  lengthy  tetts  on  one  or  ft 
few  equipments  oi*  by  shorter  teots  on  many  equipments.  As  ft 
practical  matter,  It  la  fairly  generally  rc'-ognlzeo  that  tests  on 
larger  quantities  are  more  representative.  However,  since  both 
time  and  quantities  oi  development  models  available  for  tests 
have  been  limited,  It  follows  Uiat  we  cannot  usually  place  high 
confidence  In  the  results  of  such  tests. 


li.2  ReltabtUty  Prediction  Based  on  Review  of  Paper  Design 


Workers  in  the  field  of  electronic  equipment  design  hare  re¬ 
cognized  the  need  for  detailed  .analysis  of  circuit  performance  to 
obtain  a  prediction  of  equipment  reliability.  It  Is  expected  there¬ 
fore  that  any  new  preliminary  design  for  electronic  equipment 
will  be  accompanied  by  a  reliability  pre-ilctlon.  The  thoroughners 
of  this  prediction  will  Indicate  the  extent  of  V  e  engineering  effort 
toward  reliability  placed  on  Lhc  equipment  eslgn.  A  detallej  dis¬ 
cussion  of  a  suggested  technique  will  be  found  in  Appendix  A.  ■ 


Thla  technique  Is  ba.sed  upon  having  complcle  information  on 
failure  rates  of  ail  component  parts,  and  assumes  that  a  complete 
undenitandlng  exists  on  how  to  welglt  these  failure  rales  for  the 
particular  application  of  each  part.  While  Informatlnn  ip  beginnlnf 
to  be  .amassed  on  ’'catastrophic''  failure  rates  of  some  parts,  there 
does  not  e.-dct  at  prcse.at  a.ay  organized  system  to  enqourage  gaUier- 
ing  of  this  information  or  to  insure  its  distribution  to  iiioss  It. 

Knowledge  of  propc  -  methods  of  weighting  tiiese  failure  rates  for 
'sea'crity  of  u.ae  la  also  somewhat  meager,  tven  more  meager  is 
knowiodgi.-  of  methocis  whicti  can  a.sslgn  failure  rales  due  to  deterior¬ 
ation  (not  cabstrophlc  failure)  of  pait.M  and  their  interactions,  and 
allure 


the  failure  of  .as-senibllco  to  opoiale  because  of  this  deterioration.  ■ 


This  typo  reliability  prrdirtlon  will  improve  as  failure  rate 
liif.ormallon  and  o'pfrionro  i.s  amas.'K'd,  Imwevcr,  it  presently  Is 
r.ol  at  the  stage  where  doc Ision  to  rcica.se  to  pnxiuction  could  be 
bxsed  on  It  atone. 


2.3  Compoiiei.t  Test  to  Failure  Method 


The  iwi;  rriuiKility  ev.iluaiion  mrthods  discussed  above  result 
in  cstlirates  of  f.itlure  rates  for  the  equipment  de.sign.  The  tosl- 
to^at.'ure  mothoi  millliud  below  wtil  not  artu.aUy  ylcUl  failure  rales; 
rather,  li  is  a  design  nu  lhtxl  for  assuring  adequate  safely  margins, 
which  should  result  in  lO'u;  life  mid  low  failure  rate. 


More  .specifically,  the  proponents  cf  thi.s  method  state  tha. 
every  coirp</r;crif  p.'rt,  even  If  standardized  .and  si’,n|X)sedty  very 
reii.diic,  .n-iCfl  be  suspict  n  dii  It  can  be  prc/ved  al)Ic  to  withstand 
the  ( fyipme!,;  <,  ■.•■vice  C(;,.;'i''!onc  with  the  tl's'rce  of  rcli.ibillty  re- 
qvircu.  'U'  iJiui  c:M,  q^j-.r.tiuc.';  of  each  conipo.aent  part  must  be 
u>!cior  ;'<,-rca.<;!r:rl'’  severe  cowntlocs  uatll  f.atlurr  occurs, 
fiy  varyiai;  the  foil  (c  .i;.)::!;,  th.e  vailmis  eriiical  .modes  cf  fail¬ 
ure  vnii  coconic  kaown,  ’a;,  wtil  the  ulilinato  strength  of  the  part 
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In  these  various  modes,  ^eie  adequate  safety  margina  do  not 
exist  between  stresses  and  ultimate  strengths,  the  part  must  be 
redesigned  or  a  new  part  found  with  sufficient  strength.  By  such 
methods,  all  parts  are  assured  of  having  adequate  safety  margins, 
and  low  failure  rates  should  then  result 

The  principal  deterrent  to  the  wide  use  of  this  method  liec  In 
the  cost  and  time  Involved  in  testing  to  failure  all  the  various  parts 
of  an  equipment  in  all  the  various  critical  modes.  A  further  factor 
is  that  extreme  stresses  may  actually  cause  a  change  in  the  mode 
of  failure  and  lead  to  erroneous  conclusions;  thus  good  engineering 
Judgement  is  required  In  using  this  method. 

In  evaluating  models  at  the  end  of  a  development,  tlie  test  to 
fs'lurc  method  can  be  useful  as  applied  to  supplementary  tests 
which  may  be  run  on  suspect  parts.  It  can  also  be  useful  In  the 
sense  that  a  review  oi  the  test-to-lallure  effort  may  be  valuable 
in  assessing  the  cont.-actors  overall  reliability  effort,  and  may  .aid 
In  establishing  better  confidence  that  a  rel!,^  '  t  design  exists. 

2.4  Recommended  Evaluation  Meth  -d 

The  Task  Group  recotnn.'enis  that  the  failure  rate  teat  be  ac« 
cepted  as  the  basic  reiial)illty  evaluation  method  for  devolcmment 
models.  Based  on  a  review  of  published  failure  data,  the  Group  is 
willing  to  accept  tlie  exponential  failure  distribution  for  the  purpose 
of  c,dculatlr.g  risks'and  developing  fomtulke  for  acceptance  ana  re¬ 
jection  Wl)cthcr  or  not  this  failure  distribuUou  is  e.xactly  correct 
is  belie  ,  ed  to  he  secondary  to  tho  desirability  of  cstabllehlna  life 
test  req'.»lrementfi  on  new  equipment  at  tlie  earliest  possible  date. 
The  basic  theory  and  accompanying  methodology  should  rapidly 
develop  once  the  life  test  •’erpiircment  is  firmly  and  widely  estab* 
llshed,  and  data  begins  to  be  accumulated. 

The  Task  Group  believes,  however,  that  the  failure  rate  test 
cannot  stand  alone  as  a  reliability  evalu.ation  metliod  for  dcveli^- 
ment  models  since: 

(1)  The  time  and  number  of  models  available  are  limited, 
thus  placing  broad  confidence  limits  on  results. 

(2)  Tho  development  models  are  not  necessarily  representa¬ 
tive,  as  future  protjurtlon  will  urKloubtedly  be  from  dif¬ 
ferent  lots  of  parts  and  <«ill  be  oiadc  with  different  pro¬ 
cess  controls. 

(3)  The  failure  p.ittcrn  of  the  development  models  Is  not 
necessarily  representative  even  If  all  lots  are  consid¬ 
ered  Identical,  since  only  a  small  number  of  the  multi¬ 
tude  of  the  possible  component  variations  within  the  tol¬ 
erance  llmus  vill  occur  In  a  few  equipments.  These  . 
variations  will  le.od  to  new  failure  patterns  due  to  toler- 
a.nce  build-ups,  different  applied  stresses,  etc. 

Therefore,  liic  failure  rale  tests  must  be  supplemented  by  a 
thorou;  !•<  review  of  tlie  p.apnr  de.slg”.,  parlicu].arJv  \nth  regard  to 
Invosl.gHtlon'of  operating  ( ondiilori.s  of  all  parts  as  compared  to 
ratings,  failure  f  itc.*:  as.si,'"''-d  to  ait  pans,  status  of  part  qurJlfl- 
cation  tests,  and  tho  tolerance  structure  of  Lie  de.slgn  (that  !a  , 

Will  Uie  design  .accom^xlalc  expected  part  variations  In  sciaice  and 
still  opei«le  satisfactorily). 
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Pkllures  occurring  during  perforasnce  evaluation  tents  should 
also  be  rer^eued. 

As  a  result  ot  the  design  renew,  or  of  failure  during  test, 
some  p;«ris  may  be  suspect.  These  parts  should  be  given  special 
life  tests  or  tcsts-to-failure  lo  Insure  that  adequate  safety  isar> 
gins  exist. 

The  aecislon  to  release  for  pilot  i  .ducUon  should  be  mads 
only  after  ihorou'ih  review  of  nil  information  g.-Uned  as  a  result  of 
the  overall  evalu.atioa, 

3.0  FAILU.HE  DtAGNOSIS 

An  important  by-produrt  ->f  failure  rate  testing  should  be  the 
discover#  w  residual  causes  of  unreliability  and  the  resulting 
corrective  action  to  redact  or  eliminate  these  causes .  Experi¬ 
ence  has  shown  that  the  key  to  corrective  action  is  highly  skilled 
analysis  of  each  failure. 

The  need  for  failure  analysis  has  been  hamoered  by  the  fact 
that,  tradiaor.a!ly,  test  specifications  have  assumed  that  the 
buyer's  Lniercst  was  limited  to  obtaining  falure  free  devices  that  . 
would  pass  all  specified  tests  with  a  failure  rate  of  zero.  It  has 
usually  been  sta'sd  or  implied  that  if  failures  occurred,  tne  de¬ 
vices  ceased  being  of  interest  to  the  buyer  a^-U  responsibility  for  •’ 
analysis  and  removal  of  the  cause  of  failure  was  the  private  con¬ 
cern  of  the  contractor.  Tlie  interest  of  the  buyer  would  be  re¬ 
sumed  alter  an  Improved  device  had  been  submitted  and  h^  passed 
all  tests: 

This  trao.,.onal  treatment  of  failures  occurring  during  lest  Is 
unacceptable  for  military  electronic  equipment.  The  probability 
Is  hish  that  some  failures  will  occur  during  life  testing.  The  buyer 
Is  vitally  tntetested  In  the  diagnosis  of  test-produced  failures  and 
tho  proctdu.'^  to  be  followed  must  be  an  Inherent  pari  of  the  pro¬ 
curement  sp.-cificatIon.  Tlie  following  iteois  are  pressed  as  man¬ 
datory  BpcciXication  requirements. 

(1)  Competent  engineering  failure  diagnosis  Is  mandatory 
for  all  test  failures. 

(2)  To  the  e.xtent  possible,  each  test  failure  must  be  assigned 
a  cause  suen  zs  lest  i.vstnunciilaflon  defect,  test  opera¬ 
tor  error,  part  failure,  p.nrt  deterioration,  circuit  failure 
oue  lo  Jesigner’s  failure  to  .lUow  for  .norm«J  part  varia¬ 
tions,  etc. 

(3)  'Where  failure  occurs  in  the  equipment  under  test,  the 
pe.'^.l.-iert  damagi/g  strenses  must  be  careluUy  measured 
a.'yi  reronl'd.  As  ?n  example,  If  a  capacitor  falls,  the 
pop.-.:!-!- damaHng  cjjj.uit  stress  (voltage,  or  sometimes 
cun  mci-t  be  me.a.niTrbci  and  recorded.  Furtheimore, 
the  prssible  damaging  ext.'ni.a^  btressea  (temjit’rature, 
humidity,  etc.)  rausi  a*JoLe~ mea.'^urc-U  aiid  recorded. 

(4)  tV'"  ere  practicable,  dtsa.ooenibly  aiid  analysis  must  be 
p^ri.'fzr.c-d  on  i.^l!ed  or  dctcriorat>.-d  pnrls.  Such  dteas- 
i-im'Ay  and  ar-alycla  must  be  periormiid  under  the  cog- 
uLi  .;p  of  a  re;  regent.uivc  cf  the  htiyer  who  is  not  rC3- 
yc.'j-.hlc  for  the  desit  n  or  produrtkn  cf  the  part  fsee  sec- 
li'  1  4.t;).  A  roxpi  tcnt  d!a}TiOsts  must  be  .made  In  terms 
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of  e^clflc  design  features  and  siieetfie  wrkmanahlB-  »»««, 
^  inspecao#  proceaares.  Where 
plicable,  foe  failure  diagnosis  shall  Include  an  t'alvsIsS 
contribuUng  causes  such  as  inadequate  circuit  desia 
(which  will  lujt,  for  example^  tolerate  normal  part  rarta* 
tlona  pUw  espsctaf  part  deteriorations}* 

descriptive  report  or  report  seetton  must  be 
written  for  e^h  test  failure.  report  must  assign 
responsibility  and  cover  the  diagncsls 
iw  ouUlned  above.  Where  appn^riate,  recomniepda-  • 
tlona  for  corrective  action  should  also  be  Included. 

-i-i  **  be  menUoned  that  often  the  designer's  knowledc#  la 
rlriu^r  Indlsporsable  to  adequate  diagnosis.  Thus  the  cm?S^or 

duration  of  the  reltabiilty  tests,  and  to 
li»u*«  tfca.  tills  graup  la  avail^le  for  failure  diagnosis  actlvltT 
lilt  the  failure  diagnosis  personal  be  reasonabiy 

free  from  undue  pressure  by  the  buyer  anVor  o'her  crouns  In  tl^ 
cwlra^r  s  crgantzallon  that  may  tend  to  restrict  th^Tnrestlea- 
tlona  and  produce  Inadequate  dlagiosla  or  ev”a  conce^S^ 

P«®*“re  results  from  effort* 

to  meet  Of  hcdule  and  pi.ee  cotamltUnenls  by  the  contractor  It 
may  Umt  some  relief  must  be  extwiJed  by  Uie  buyer  in  tld*  re- 
garJ  to  order  to  gain  the  desired  resulto.  ^ 


<•«  Stp»ERVI«g(W  BY  INDEPEWDEarr  EVALUATIOX  GROtlP 

Ta^  Group,  this  prir^lple lould  have  bea,  proliuSjy 
to  the  responsible  government  grouo  oa  mill  Thirn  i  mTrt-tTTurnr  • 
group  responsible produelfCTen  Sdi  toTLIST 
desl^  was  iwrlormed  by  a^ommerelal  fliS) 

evaluallon  group.  Some  other  government  group  on  at 
least  an  equal  organlzallonal  level  with  toe 
group,  should  liave  tols  responsibility  government  des.gn 

ff-a  J!'}*  possible,  and  in  the  Group’s  opinion  permissible  that 
the  endre  testing  and  evalaa'Jon  prograSi  be  cayirf  o^  b'v  ■ 

itberatoriea  provided  Uut 

depe^ence  cited  above  Is  maintained.  In  iiSnt  r^L-7«rrnr 
swuld  supervise  tlie  ev:aoutlon  ol  his  own  pj^uct  for  ' 

hlH  d^ign  and  evaluation  gwups  areprelSiv' 
InJc-pendt-ai;  tlus  reolrlrtlcn  does  not  preclude  the  ^ 

Elite.  '“»>»«  E?mc«',E. 

lA'"  '"'O^o’or.ded  that  independent  evaluaiion  o* 
teats  he  arcomplln.hcd  by  r>q«toiP,, 
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by  the  evaluation  group.  Superryton  atvui  include  out  not  necet 
tariiy  be  restricted  to  the  iteins  Uaied  below: 

{1)  Review  ol  rontrsctor’s  reliability  effort,  including  the 
reliability  prediction. 

(2?  Approval  ot  the  proposed  detailed  test  plan  for  reliabll 
ity  tests. 

($}  Approiml  of  the  test  facilities  to  be  rraed  for  the  test  pro 
gram. 

(■i)  Review  of  data  preparatioc  and  test  progress. 

{51  Surveillance  of  failure  diagnosis  actlvitlea. 

.(£)  Approval  of  test  logs  and  /allure  diagnosis  reports. 

(7)  Approval  of  supplementary  test  programs,  such  as 
special  tests-to-failure  on  certain  components,  con¬ 
ducted  as  a  result  of  the  reliability  evaluation. 

{£)  Approval  of  contractor  pr^jared  report  covering  relia 
biiity’ teats. 

(9)  Preparation  of  any  necessary  independent  report,  In¬ 
cluding  recommcndatic-cs. 

It  should  be  emphaslaed  that  the  purpose  of  the  supervision  out 
lined  a^.•’ve  Ls  in  no  way  intended  to  usurp  any  trf  the  cnr.tractor's 
usual  res po’slbili tics  with  rsgird  to  such  test  prog4*am«.  On  the 
Cl-,  trary,  the  contractor  -wouid  ba  normally  espected  to  supply 
peracrr:sl  to  actually  perionn  all  required  teats  a-nd  to  furnish  nec 
ossarrdixa.  la  particular,  he  sheuia  furnish  failure  diagnosis 
eerv'res,  si.cce  the  de8;gTier'8  knowledg**  is  often  IndlspensibU  to 
perforx:r.g  adequate  failure  diagnosis. 

5.0  RECOMMENDED  FAILURE  RATE  TE?TS 

5.1  Written  Agreements 

The  efiert  to  be  expended  by  the  contractor  in  mecling  relia 
blitty  req-.iirecients  should  Ik-  specUied  in  the  contract.  Miolinum 
contract  rc-vyairements  should  include: 

(a)  SwctfJcallo.iS  lor  a  mesa  lime  to  failure. 

(b)  roiermnee  limits  on  the  perfarraance  sjwclficatWns  which 

'•XT  be  used  to  define  a  la'lurc  durt.-.g  the  failure  rate  test 

(c)  Requirement  for  a  failure  rite  test  to  determine  compll 
arce  with  Uie  mean  time  to  fa;l-jre  specif Icallon.' 

Tull  v.iit.  n  njirermf  .d  sir-uld  be  .-'’ached  between  the  con¬ 
tractor  ...  d  i-^yvT  wttji  reiM.-d  tc  o.sc--  ;s  of  the  reU.uhillly  tests 
prior  to  s'.ir.  •  f  iliu  failure  r-tlr- ••;:,  Liti  r  s'”'tj.'*r.c  of  .his  rc- 
>Airt  ocr..;..'.  (or  iltn  =  l-o  in<*{uded  in  the  per 

form.-mc-  the  c.  ;  ;a  ust  pivccvidrcs 

and  .v..-.';.;.;  .1  d  ’cw.ienin.  !;  •  -  ’  •  pir-ioulariy  itrivi 

ai'.t  ih;.'.  .  .  ru:cs  io  r,.-nri  {-..‘.r'r  -.c  r-_:.'>i,!si:e<i.  this  need 

Ifl  fle~;r  .~c'  ?J  oy  .t  re'.  i  r.*  <  v  •  -e  n;t  .'u  tirre  to  f2li.-re 
of  .-r  f.'.'t.;.  y'c,'  of  i-q;. ;  c..  r.-  b\  so’/crol  f.,'uup» 

v.TrifO'  '  •  rifiit  (U  {•'.-{'u.T.abl,-  b.-i-sed  t.hi* 

same  ciot: 
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CtaractertattcB  to  be  Measured 


These  characteristics  should  be  covered  tn  some  document 
such  as  Uie  equipment  specincation  or  test  procedure<  It  is  re* 
commended,  however,  that  the  number  of  items  to  be  measured 
be  kept  to  a  minimum  in  order  to  reduce  the  Instrumentation  and 
manpower  problems  associated  wUh  the  tests. 

5.3  Number  of  Models 

At  least  two  models  should  be  allotted  for  failure  rate  tests 
in  order  to  reduce  total  test  time  and  in  order  to  h.tve  a  more  rep¬ 
resentative  sample. '  This  number  should  be  considered  a.',  absolute 
minimum  except  In  special  cases,  such  as  extremely  complex 
equipment;  every  effort  should  be  made  to  Increase  the  number  of  - 
models  associated  lor  these  tests  in  order  to  gain  better  assurance 
that  the  desigm  is  capable  of  meeting  requirements.  More  than  two 
models  will  reduce  the  probable  test  time  proportionately,  except 
that  tlie  group  recommends  that  all  models  be  run  at  lecst  three 
times  the  contract  mean-tlme-to-failure,  (refer  to  section  5.6  and 
Table  1). 

5.4  Enylronmente 

The  Group  h.ns  considered  many  possible  environments,  and 
combinations  of  environments,  fleveral  factors,  however,  argue 
for  minimizing  the  variety  of  Imposed  environments,  particularly 
at  this  time.  T'iiese  factors  are: 

(1)  Eaviropmentai  equipment  is  severely  limited  at  many 

contractors'  facilities.  .  -  ' 

(2)  In  the  initial  stages  of  reliability  evaluation  program ,  s 
simple  test  procedure  will  expedite  acceptance  of  the 
program. 

.  (3)  Fairly  simple,  standard,  environmental  conditions  would 
.  aid  in  developing  standards  of  comparison  for  equipments 
and  in  amassing  uniform  part  life  ^ta. 

The  following  guides  are  therefore  suggested  for  imposed 
environments: 

(1)  On-off  cycling  at  a  rate  approximating  service  use. 

(2)  Usage  cycling  such  as  tuning  radio  equipment  to  various 
(fequencies,  scanning  with  radars,  etc. 

(3)  0>  -ration  at  nominal,  maximum,  and  mintnlum  line  volt- 
agr-H  (mnasarements  at  other  thaii  nom-M.'il  line  voltage 
should  be  kept  tc  a  minimum  in  order  to  reduce  lest  com¬ 
plexity). 

(4)  Teinpcraturc  cycling  Irom  normal  room  ambient  to  spcc- 
ifird  t!i:iAimuni. 

{5)  Wild  Vibration  where  ar.plirable.  In  most  case.s  this  cn- 
virorimei-i  s:iOuT'JT.'i-T!j7:n!:t.'o't'i  that  wiiich  can  be  pro- 
diu  <-C!  by  some  simple  inea.-.e  such  as  pl.icSng  the  equip¬ 
ment  on  ro.'ijUe'u  n-.oiir.ts  and  ’’driving"  it  by  nieuna  oT  a 
r('l:itli;[r  off-center  weight  (to  mliiiiui.'.c  envlroiiDiental 
equ-pme.-.t  comp  lexity) , 


The  above  environments  can  be  obtaltiod  with  s  minimum  ct 
ejqwnstve  equipment.  The  temperature  cjcling,  for  example,  can 
be  obtained  by  enclOv-'ing  the  equlpmenl  In  an  Insulated  lex  and  con-  - 
trolling  the  external  cooling  iu‘r.  It  Is  recommended  that  full  con¬ 
sideration  t'e  idven  to  establishing  the  various  cycles  on  a  dally  . 
basis  eut'h  tiial  all  or  at  least  a  majority  of  Uie  necessary  adjust¬ 
ments  and  measurements  can  be  made  during  a  normal  eight  hour 
working  day. 

As  the  reliability  teats  t.«come  firmly  established  and  more 
experience  is  (r^'r.co,  It  is  expected  that  the  enviromaental  require¬ 
ments  will  be  adjust^  accordingly. 

5.5  Definition  of  Failure 

Fcr  the  purpose  of  failure  rate  test,  a  failure  sivHild  be  defined 
as  operation  outside  assigne-d  tolerances.  Thus  each  characteris¬ 
tic  to  be  measured  should  be  assigned  a  tolerance  In  the  perform¬ 
ance  speciilcation  such  that  a  failure  is  counted  if  this  tolerance 
is  exceeded.  These  "f-'lure"  tolerances  must  be  wisely  assigned, 
with  due  allowance  for  deterioration  of  parts  with  age  and  in  general 
should  be  wider  than  normal  f.actory  tolerances.  Conversely,  fact¬ 
ory  tolerances  should  be  so  set  as  to  allow  for  known  aging  of  parts 
on  a  statistical  b.'isls  so  that  there  is  high  probability  of  meeting 
Ihe  "failure"  tolerances  during  the  life  of  these  failure  rate  tests. 

Allowable  adjustments  and  preventive  maintenance  must  bo 
carefully  specified.  In  general  the  Task  Gro'ip  recommends  that  ' 
no  preventive  maintenance  be  allowed  except  in  special  cases  such 
ajs  complex  computers  or  rotating  machinery  where  regular 
checks  am  normally  conducted.  These  special  cases  should  be 
covered  In  the  test  procedures. 

Details  of  scoring  failures  during  tests  must  be  precisely 
staled.  Suggpstr-d  ruleu  arc  covered  in  ARiendlx  B. 

6.6  Acceptance  Criteria 

Tabic  I  Is  provided  In  order  to  arrive  at  accept  or  reject  de¬ 
cision.*?  (or  equipment  luider  failure  rate  teats.  Note  that  the  tabic 
!s  nrtscnied  in  '  of  the  irontract  mc-an'ttme- 

bctwccn-fatluro;  l.c. ,  *J:e  actu.il  total  accuiavlated  test  time  on 
all  equtnnieiits  under  test  Is  divided  by  the  -ontract  oiean-tlme- 
betwe'vn-i.illuic  (inverse  of  the  (allure  rate,  pr.lor  to  entering  in 
table.  Alter  efitering  the  table,  the  total  number  of  failures  oqjer- 
Icnctd,  fnnrid  In  the  appropriate  col-umn,  will  determine  whetlier 
to  ••c’fct,  accept,  or  ccntlr.ue  tesllng.  Koto  also  that  it  Is  stipu¬ 
lated  that  110  diel.'.lon  can  be  made  until  each  equipment  lest  has 
accumnlaifd  at  le.ast  three  tj.Ties  the  contract  mean-Ume-between 
failure.  Tl'l.*.  provision  i.*;  made  in  o-der  to  give  some  assurance 
that  equlpmenl  with  unduly  sliort  life  will  be  rejected. 

T.nlde  t  h.au  In  Oil  c.alculatod  on  the  assumption  that  time  be¬ 
tween  f.niiurc.*;  of  the  etnni'.'iei.t  v;ll  be  e’.po.ne;itlally  dlatribured. 

For  the  pnijw;.,'  f!  lo;.'..  u  IS  v.ln.j  tlist  the  failure 

r.Me  ff  i!,r  Cv'|v.i,aiic  •!  UrJer  test  ir.  lejiri-ie.dalivs  of  the  deslipi. 

Tti'r  lalt'-r  jv-.mi,  '/I'l  the  rl.*'!-'?  di.*:ci:.;.',t'.s  tselow,  6lK.‘_fd  be  c.’early 
uii-ieisivo.I  Iv  the  i  pecitpsiig  co.ilract  v.  lues  for  failure  rates. 

It  !•'’  u!:d.Ti!.'0.i  that  my  ram.pJlm;  plan  has  certair.  risits 
a-;son.ilcd  '.vitl.  It.  It  mus:  .'’“so  be  noted  that  the  plan  recor.i mended 
here  is  a  ipll;>-:  plan.  1  ho  ;ilifrr.;dlvc{to  obtain  true  failure  rate 
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for  the  eanipie),  would  require  that  the  equipment  be  ra  on  life  teet 
indefinitely  to  accumulate  the  supporting  data.  The  rteks  Involved 
may  be  described  by  an  operating  characteristic  curve  such  as  that 
shown  in  Figure  2,  wulch  is  applicable  to  the  Table  1  plan. 

Thus,  equipment  which  has  a  normalized  failure  rate  of  1.0 
(1.  e. ,  exactly  equal  to  the  contrrurt  failure  rate)  wottU  have  a  90% 
chance  of  acceptance  (and  10%  chance  of  being  rejected.  Equip¬ 
ment  which  has  a  normalized  rate  of  2.0  (twice  tne  costract  v^ue) 
would  have  only  a  10%  chance  of  being  accepted.  Obber  tables  may 
of  course  be  devised  for  vr.rioua  other  ricks  and  failure  tales.  For 
example,  *'te  10%  probability  of  acceptance  point  may  be  moved 
from  2.0  to  l.S  ur  'ven  1.2.  However,  such  action  Is  the  equiva¬ 
lent  cf  stating  that  much  more  confidence  is  desired  is  the  results 
and  a  longer  test  would  result. 

The  plan  presented  In  Table  I  has  besn  chosen  as  representa¬ 
tive  of  the  shortest  test  believed  oy  the  Group  to  oe  practicable, 
since  further  attempts  to  abbreviate  the  test  veuid  resalt  (n  undue 
risks  to  both  buyer  and  contractor.  If  sufficient  time  aod/or 
modele  ere  available,  a  test  plan  should  be  cued  which  further  re¬ 
duces  the  risk  to  both  parties.  In  order  to  make  such  decisions,  ’ 
a  set  of  test  plana  and  accompanying  operati.-'^  ciuuwcteristte  . 
curves  should  be  prepared  and  made  available  to  those  responsible 
for  establishing  failure  rate  tests. 
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5.7  Data  Handling 

The  consequences  of  a  reliability  test  are  of  such  major  im¬ 
portance  to  both  buyer  and  contractor  that  rules  and  procedures 
governing  conduct  of  the  tests  a.'.d  interpretation  ci  test  results 
musi  be  established  prior  to  beginning  the  tests.  Rigid  adherence 
to  th.s  principle  and  to  the  rules  once  established  will  minimize 
dtsagresments  as  to  Interpretation  of  data  and  tnse  test  outcome; 

The  system  of  rules  and  procedures  and  data  keeping  should  ■ 
have  the  following  objectives: 

(11  Prnvidu  z  contliiauus  record  of  pcrlorus  ance  <4  test  er-eei- 
men  and  teet  facilities. 

;2)  Document  all  test  deviations. 

(3;  Insure  keeping  ot  adequate  data. 

-  (4)  Mini  mice  errors. 

(5)  Provide  for  arrtvirg  at  accept- reject  decision  in  mini¬ 
mum  time  with  nMntcJum  areas  of  disagreement.  This 
means  clear  rules  for  interpreting  data  and  scoring 
failures. 

<5;  Insure  adequate  failure  diairnosis  and  its  documentation. 

■  'll  Provide  for  recomrner.datior.s  (or  corrective  a-.tlon. 

(8;  Test  documents  a-nd  i:;sg.  wnen  completed,  should  be 
able  to  be  combined  logetner  into  a  fiiia.’  report  which, 
when  ijjpro’/ed  by  eva;vi,.r.i  agency,  will  f;.-ly  document 
the  tests 

Require  approvals  necesiary  to  assure  prefer  control  by 
■tte  group  flupervisir^j  tive  tests  (see  Sect^sr.  4.0), 
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table  I 

AccQit-KcJect  Criteria  Per  FaUure  Rate  Tertliwf 


Multiples  of 
Contract  aean* 
tizne-between- 
failure 


Reject  If  number 
of  failures  below 
occur  on  Or  before 
time  in  Column  1 


CoJilTnue  Teat  IT 
number  of  fail¬ 
ures  fait  In  ranee 
below  at  time  In 
Column  1 


liccept  if  no  more 
than  {.inaber  of 
failures  l^low  oc¬ 
cur  by  time  in 
Column  1 


3.00 
3.32 
3.58 
4.01 
4.27 
4.70 
4.03 
S.39 
5.65 
6.00 
6.34  . 
.6.77 
7.03 
7.46 
7.72 
0,15 
C.4J 
6.10 
9.79 
10.30 


3 

8 


9 

10 

11 

12 

13 

14 


15 

15 

IS 

IS 

15 


2-7 

2- 7 

3- 8 

3- 8 

4- 9 

4- 9 

5- 10 

5- 10 

6- 11 
6-11 
7-12 

7- 12 

8- 13 

8- 13 

9- 14 
9-14 

10- 14 

11- 14  - 

12- 14 


1 

2 

3 

4 
9 
8 

7 

8 


9 

10 

11 

14 


NOTE  Ir 


between  fa.turr  *^  "  '"•an-iime- 


NOTE  2; 
note  3; 


eufJdUy  ailV  •  tpm^ Hnder  failures  eaper I- 


.?ree  equal  m 
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Appendix  B  describes  «  8*atein  which,  in  the  opinion  of  the 
Ttsk  Group,  satisfies  tie  above  requirements.  Thts  system  is* 

'  eludes  elements  that  have  been  found  useful  in  s  particular  tc" 
program  of  similar  nature.  These  requiremenis  may  seem  unduly 
restrictive;  however,,  relaxation  of  such  requiremeiits  will  inevit¬ 
ably  lead  to  less  pt:;ci*s  methods,  less  accurate  records  and  analysis, 
and  less  assurance  to  the  buyer  that  the  produce  is  adequate. 

A  particular  system  will  not  be  recommeruled  here  since  ob- 
vlOttSty  the  intent  of  the  system  described  in  the  objective  abenre 
and  in  Appendix  B  cou.d  le  met  by  different  combinations  or  group¬ 
ings  of  the  total  required  information. 

e.O  PROCURE?dENT  PRACTICES ..  ... 

While  not  within  the  scope  of  this  Task  Group  missimi,  present 
procurement  practices  rhich  aim  to  provide  accelerated  delivery  of 
electronic  equipment  tend  to  minimize  the  time  allowed  for  adequhte 
reliability  evaluativU.  This  is  considered  s  problem  of  the  military 
esrvlc**  development  and  procurement  practlros  charged  to  Task  Grotqt 
Six  and  is  of  primary  importance  in  the  process  of  achieving  improved 
reiiabillty  of  military  electronic  equipment.  Task  Croup  Two  is  es¬ 
pecially  alarmed  at  the  trend  away  from  the  orderly  development  pro¬ 
cesses  In  the  present  practice  of  telescoping  development  with  proto¬ 
type  or  production  procurement  at  the  expense  of  a  sound  reliability 
test  prc^rain  during  the  v.'.al  development  engineering  phase. 

Additionally,  it  spii^ars  ttiat  present  spare  parts  procureme.nt  pro¬ 
cedures  tend  to  negate  improvement  in  reltabitUy  which  might  be 
xibtaincd  during  the  development  of  the  equipment.  This  is  brought 
about  by  the  fact  that  adequately  tested  components  and  circuit  element, 
should  be  assembled  in  the  tested  and  delivered  military  electronic 
equipment.  However,  the  procurement  practices  do  r.M  necessarily 
specify  that  the  parts  provided  as  spares  for  this  equipment  should  be 
procured  under  the  same  rigid  bpec'fication  ai)d  reliability  testing 
program  as  performed  on  the  original  components.  Thus,  unreliability 
Slid  non-predictable  reliability  can  very  well  be  built  into  a  reitable 
'  equipment  by  the  Inclusion  of  questionable  or  non- reliable  spare  parts. 

7.0  coNCLUsioyg 

7,1.  Requirements  for  reilablllcy  evaluation  by  mearj  cf  failure 

rate  tests  of  developm«ml  models  have  been  presented.  T.hese 
teats  .ire  intended  to  give  assurance  that  the  design  Is  capable  of 
meeting  a  required  failure  rate  (cr  Bjean-ttxe-between-fjulure). 

7.2  Since  the  number  of  samples  and  time  available  for  failure 

rate  te.etin-;  is  ui,aaliy  ceverely  limited,  the  failure  rate  estab- 
IlE.hjd  by  Uio  tests  ulll  liave  tiAiai  coa'ldence  limits.  Therefore, 
before  deciding  whether  or  net  to  rele-ise  lor  pilot  produetten,  the 
test  pi'ogram  mi!.«t  be  siqipieraented  by; 

(1)  A  thorough  review  of  the  contractor's  reltsbllity  effort, 
particu’.arly  ids  paper  design  and  part  qualification  and 
scioctio.'.  ciJon, 

(2)  Suppiemfi.rai  tests  on  parts  found  suspec*  as  a  result 
of  the  tests  or  'V  rel'.abiUty  review. 

*1 


Observation  of  the  principle  that  no  design  or  manufaetturlng 
gtovip  should  evaluate  its  own  product  is  vital  to  reliability. 
Therefore,  independent  evaluation  groups  should  supervise  relU« 
blllty  test  programs. 

All  important  by*ppo(i'*e^  6t  reliability  testing  should  be  tiis 
discovery  of  residual  causes  of  unreliability.  Competent  engln* 
eerlng  failure  analysts  should  be  mandator)*  for  all  test  failures 
in  order  to  Initiate  adequate  correcUve  action. 

The  Department  of  Defense  must  review  and  revise  as  neces¬ 
sary  its  regulations  pertaining  to  research  and  development  and 
the  procurement  of  equipment  and  spare  parts..  In  some  cases, 
conflicting  regulations  exist  which  tend  to  negate  good  procedures 
and  practices  outlined  in  other  regulations.  Whil'i  this  task  is  ex¬ 
plicitly  assigned  to  Task  Group  Six,  it  is  also  emphasized  here, 
since  <t  is  felt  that  improvement. of  the  development  article  cannot 
be  assured  without  some  changes  in  procurement  practices  aimed 
specifically  at  installing  the  controls  recommended  herein.  Fur¬ 
thermore,  improvement  at  the  produce  bt  futile  u.nless  spare  parti 
procurement  practices,  and  similar  regulations  will  allow  high 
quality  to  be  mamtained  during  the  service  life  of  the  equipment;  - 
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PREDICITOff  or  SOOlPUEKT  RSUABUilY 
DASKD  KEMS9  OF  PAPER  OESIGM 


TLe  ietlgr.  of  eostplcx  9}«o%7oaie  equipment  has  been  concerned 
mostly  with  the  nchievoment  of  iwrfonsance  requiremests  .it  the  time  of 
Inttlsl  testing.  itelishlUty  esamKles,  if  nude  hi  aU.  hare  been  computed 
■17  the  simple  formula  eousUnf  the  cpcrail  relialitli^  to  the  product  of  Ite 
eompcaent  parte  reUaotUtjr.  tProdoet  rul^ 

Each  a  fonnuiat  is  the  tititrate  la 'etapllflcatlcin  because  It  does' 
aot  eonstdor  the  effect  of  the  atrwses  applied  to  the  parts' as  a  consequence 
of  the  assemblage  of  them  into  tha  e<pdpTeot.  It  also  neglects  the  many 
isieractiocs  that  arise  from  the  eoxci.’urlpa  of  ranous  components  sod  the 
many  conditions  ri  CPeralion  pocuh&r  to  the  particular  equipment.  Ax.  er^* 
nation  of  overall  eqiupment  reUal’Uity  must  edneidsr  the  esect  of  enIrtrOQ* 
moot  and  operaiicK  condiaons  rpas  ptra  life  and  must  determine  the  actual 
dependence  of  the  equipment  failure  to  P-Cts  fallnre  in  a  detailed  analyaia 
of  the  equipment  components. 

An  analysis  of  this  aatuxs  has  bees  compared  to  a  stress  anslysts 
In  mechanical  engineering  but  it  inrolTas  many  more  variables  Uian  slmpls 
stresfi(:9  and  strains.  It  may  become  eati^mely  complex  if  carried  to  itt 
olUmats  conclusion.  .  •  .  . 

Many  attempts  at  relinbUity  analysis  at  varloos  isrsls  of  apprtud-- 
mation  have  bei:n  mode  by  the  maicr  electronic  compasies,  and  several 
papers  lurve  been  publish'd  on  the  ruhjfct.  It  is  expected,  therefore,  that 
any  new  preilmlnary  desSitn  (or  electronic  equipment  scbmltted.for  approval 
to  the  Armed  Forces  will  he  accompanied  by  a  reiisbllity  analysts  to  prt.- 
dict  at  least  what  order  of  ma(nitt\xie  to  expect  for  the  rellabilitr  of  the  com* 
plated  equipmeat.  In  future  years  the  estent  of  this  analysis  rill  certainly 
indicate  the  extent  of  the  engineering  effort  placed  on  the  design  and  preUrn* 
Inaxy  develqpment  of  the  equSpmoot. 

As  indicated  hy  the  widely  lilfferenl  approaches  to  the  problem  pub¬ 
lished  in  the  literature,  K  vrouid  be  unrcasonahle  to  establish  a  detailed  set 
of  rules  on  Imw  to  perform  a  reliability  rr.alys:e.  They  would  become  ob¬ 
solete  almcit  before  publication  s.'>d  they  couid  not  cover  all  tJie  reqtdre- 
ments  of  tne  great  variety  of  el,"cti^c  eq'iip.-nents  now  in  use.  In  this  sec¬ 
tion  only  a  pw  general  ideas  will  be  mve.n  to  Indicate  the  broad  scope  un 
analysis  of  failures  should  Involve,  arid  the  few  essential  assumptions  and 
ground  rules  will  be  mentioned  that  must  be  considered  to  obUJn  valid  re¬ 
sults. 

Parts  failure  has  been  dlrtdod  by  other  workers  In  this  field  Into  two 
general  clatmca,  In  th**  first  are  failures  fn>Jaced  hy  random  catastr'^hlc 
changes  in  Uie  part.,  forming  tl.f  t.yu-?3eKi,  cha-nges  tlmt  are  not  particularly 
aiTecied  by  stresses  applied  hy  l.’-.e'eqmymcr.t  but  are  pr  duced  by  Inherflnt 


ataUunctiqtlng  of  Uio  part  ttneV.  .The  sccotxl  clau  includes  failures 
are  produced  by  the  combinaUon  of  detertoratlon  cd  the  part  and  the  failure 
of  the  subassembly  or  componeut  to  operate  because  of  the  deterioratstf 
characteristic  (A  the  parL 

Cr.e  could  explain  these  tao  categories  as  being  produced  >•  the  first 
by  the  state  of  the  art  of  the  parts  manufacturing  industry,  and  the  ssMsd 
by  the  engineering  level  of  the  designing  agency. 

Die  first  la  practically  independent  .of  the  way  the  parts  ars  asa«a« 
bled  id  the  equipmenl,  and  therefore  it  ia  easy  to  (praise  its  ettect  os  ths 
overall  failure  rate  of  the  equipment  by  taking  the  product  rule,  ffoserer,  - 
since  quality  control  ahouM  be  cosuinuousty  improving  the  quality  levtf  of 
parts  production,  this  category  of  defects  should  decrease  to  s  low  vaW  tl> 
though  it  must  still  be  considered  la  the  overall  evaluation. 

The  second  clasa,  or  deterioration  failures,  is  the  most'diffkuit  to 
appraise  but  appears  to  be  the  dominant  oi;e  even  In  relatively  obs<dets  Sdutp* 
meats;  this  is  ahown  by  AIUNC  field  Investigations.  It  determines  vdMther 
the  design  of  the  equipment  has  taken  Into  conslderatior.  the  time  vartsUon  of 
parts  characteristics  with  large  enough  mai^  to  reduce  the  proltobili’  /  of 
failure  of  the  equipment  within  the  required  limits. 

A  failure  analysis  lor  deterioration  effects  may  consist  of  a  dstallsd 
study  of  each  component  circuit  and  its  component  parts,  through  ths  use  ei 
muIU-variate  analysis,  or  may  determine  only  the  dominant  causes  of  1SU» 
ure.  In  any  case,  it  siiould  determine  how  greu  a  margln  of  perfortnancs 
the  component  circuit  possesses  for  the  expected  variation  of  the  charseter*  *' 
Ifltics  of  each'  component  part  during  life  or  at  least  for  these  characteristics . ' 
that  are  domlna.  n  the  mechanism  of  deterioration.  (Failure  due  to  poor 
quality  in  componenhi  assembly  cannot  be  detected  by  paper  design  snUysts) 

This  approach  Implies  that  the  part  falls  only  when  the  component  of 
which  it  Is  a  member  is  falling,  and  therefore  puts  a  new  and  rari^le  mess* 
ing  to  ihe  concept  "parts  failure".  In  other  words,  the  dependence  betwees 

farts  fadiurg  and  component  failure  is  not  Invariant  hut  Is  a  functios  of  . 
esilgn. .  In  Ujis  case  the  product  rule  does  not  apply  unless  corrections  sre 
introduced.  For  example,  if  the  product  rule  is  used  for  an  amplifier  stags 
which  falls  to  deliver  the  required  output  vdien  the. tube  has  reacht-d  50% of' 
its  original  mutual  conductance  value,  this  point  will  be  considered  toe  limit* 
ing  value  to  assign  failure  rate  lor  the  tube  in  that  component.  If  another 
cempunent  with  tiiat  same  tube  type  falls  ttocn  th^  mutual  conductance  has 
reached  only  S9%  of  its  original  value,  that  tube  type  should  be  assigned  a 
much  higher  fa'luie  rate  when  the  second  ctmiponent  is  considered. 

Failure  analysis  requires  knowledge  of  performance  of  all  parts  ttn* 
der  the  various  conditions  of  operation  and  periods  of  time.  The  Interaction 
that  char.'mterisiice  of  the  various  parts  may  have  upon  each  other  and  on  the 
overall  performance  must  also  be  known.  This  knowledge  Is  now  extremely 
me.nger.  Some  o!  the  few  available  data  are  found  in  the  relcrences,  bvf 
many  more  are  being  avcumtiiated  by  varioim  activities  in  the  many  recently 
organi:ied  nciiabil't^  Departments  of  equipment  manufacturers. 

y>’e  can  say  that  at  the  present  time  we  are  at  the  stage  of  making 
the  very  first  rough  approximation  on  the.se  metheds  but  every  future  eval> 
uatlon  based  upon  this  first  e.ypsrier.ce  v.'ill  be  a  more  .accurate  a^iproxlms* 
cion.  By  coI!cctli;g  and  using  all  data  obtained  in  successive  approxlma* 
tiona,  "reliability  analysis  will  become  a  valuable  engineering  tool  in  the 
very  near  fttlure. 
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In  order  to  obtoln  •  valid  conpolaltOA  at  rellaUlitr  for  an  e4ulpB*Btj 
It  la  Important  to  obaerva  aeveral  general  mlaa.  Tba  moat  important  onaa 
ara  Hated  hera. 

Whenever  the  product  rule  la  used,  the  part*  compoalng  the 
unit  must  be  Independent  and  In  aeriea,  that  U.  failure  of 
any  part  s  rodures  failure  of  the  component  or  unit.  (Unit  be* 
tng  equal  to,  or  smaller  than,  acompoaent.) 

Wlienever  a  simple  condition  of  independence  U  not  apparent 
the  intoraction  of  the  various  parts  must  be  corjidered  and  a 
failure  probability  assigned  to  the  unit  rather  than  the  purls. 

Whcnr'er  redundancy  In  atty  form  Is  present  tt  la  necessary 
to  subdivide  the  equipment  into  components  in  such  a  my  that 
the  effect  cf  redundancy  and  dt^Ucatlon  can  be  fully  astimated.  . 

Whenever  apccial  environmental  or  operating  eondttibna  ara 
BliecUuz  mere  than  one  part'  in  the  equipment  their  effects 
should  be  assigned  to  the  largest  unit  affected  rather  than  tha 
Individual  parts  or  compoaents. 

If  more  than  ene  mode  of  operation  Is  possible,  the  compon-^  *>- 
ents  involved  in  the  various  modes  must  be  clearly  separated 
*  and  a  reliahtlity  figure  must  be  computed  lor  each  of  the  modes 
•  considered. 

In  eder  to  avoid  difficulty  In  computation  arising  from  the 
various  distrlbuticns  of  failures  as  functions  cf  time,  it  is 
better  to  compute  the  failure  rate  for  a  given  pertcxi  of  time  * 
for  the  various  components  and  then  combtoe  them  to  obtain 
the  failure  rate  of  the  equipment,  if  hours  are  used  as  units 
of  time,  then  the  failure  rate  will  be  the  prcbfi^ilUy  of  failure 
in  an  hour.  For  parts  showing  normal  distribution  of  failures 
or  generally,  a  lallure  rale  increasing  vrfth  luce,  the  period 
of  time  Cimsidered  should  be  specified.  Since  lor  complex 
.  equipments  it  is  safe  to  as.<iume  an  exponential  distribution  at 
time  between  fuiivres,  that  is  a  constant  failure  rate,  it  is 
e.asy  to'convert  the  failure  rate  into  mean  time  between  fail-* 
ures  or  into  the  rciiability  function  for  the  eqtapment. 

As  .an  example,  a  procedure  for  a  desl^  stage  prediction  of 
reliability  of  a  new  equipment  could  be  made  br.foaowing  the 
12  steps  listed  below. 

STEP  1:  Define  the  equipment  explicitly  and  uniccely  in  terms 
of  its  functions  and  boundary  points.  Once  the  eq-pment.ls 
rine3,’fiiKnyie  bperating~ebndiubn8"'as  well  as  lae  performance 
characteristics  with  ejdremo  allowance  verlabons  are  known, 
then  the  frJlure  of  the  equlp-ment  is  automatically  defined  as  be¬ 
ing  the  conditions  in  which  the  equipment  opera:^  outside  the 
aliove  mentioned  allowable  variations. 

STEP  2:  gpfcclty  thn  components  ytthin  the  sr?tem.  Compon¬ 
ents  must  1501111 '.lUuJTy  idcrnlfiaoio  withcuf  dupSciuen  and  must 
be  selected  in  such  a  way  as  to  lake  into  accc-irc  eny  redun¬ 
dancy  and  Irvlepcndcnre  of  operation.  A  wise  sotd.viston  Into 
components  v.ili  make  the  cotuputatlon  of  cverall  rebabillty 
more  st.'alplitforward  and  accurate. 


STEP  S:  Select  th<  ptrU  which  ittect  ■yotem  unrcllaittllty. 
Within  each  cotnpon^  some  parts  have  ft  very  eiuiiU  itffett  M 
reliability  and  can  tie  disregardeo  for  s  firet  approxlmstloo. 
Other  parts,  instead,  have  a  dominant  effect  on  the  reUablllty' 
of  components,  either  because  of  their  large  rounber  or  be« 
cause  of  their  large  failure  rate. 


STEP  4:  Determine  a  failure  j^c  for  each  part  or  clasa  of 
parts  usiod  in  each  component  of  the  eystem.  Upaitaare 
grouped  and  not  analyzec  singly,  then  ciasstfication  of  part* 
could  be  made  In  terms  o!  homogeneity  cf  fuilure  rate,  eudi 
as:  tubes  with  high  temperature  of  operation,  tubes  vrith  Ibw 
temperature,  tribes  that  can  deteriorate  to  the  life  test  end 
point,  tubes  that  can  deteriorate  well  below  life  test  end  ptdnt, 
condensers  with  high  voltage  applied,  reaisto.-s  t^th  high  power 
rating,  etc.  From  data  obtained  in  the  references  mentioned, 
or  other  a/ailable  sources,  the  failure  rate  as  related  to  the 
various  stresses  applied  to  the  parts  will  be  estimated.  In  tiw  . 
case  of  new  parts  or  applications.  It  may  be  necessary  to  ob» 
tain  new  data  through  special  Investigations. 

STEP  5:  Determine  a  preliminary  figure  for  the  failure  rate 
of  each  component  within  tfie  eoulpmentl  Add  the  failure  rate, 
for  all  parts  in  cacr  component  Of  the  equipment  as  determined 
in  Step  4  to  obtain  the  preliminary  figures  for  component  fall* 
ure  rates. 


STEP  6:  Determine  the  ccrrccttcn  factors  to  be  used  to  modi* 
fy  the  preliminary  ffgures  for  the  failure  rate  of  each  compon*' 
en_t.  .Some  eifects  of  dependence  between  part  -and  compraiml''*' 


can  be  accounted  for  bv  a  single  correction  factor  in  ihe.com- 
•ponent  failure  rate  if  it  has  not  been  considered  when  the  parte 
failure  rate  was  computed.  As  was  mentioned  previously,  in . 
many  c.'ises  when  stresses  are  ai^lied  to  the  whole  componod; 
it  is  more  practical  to  apply  a  single  corrbcUon  to  the  compel' 
ent  rather  than  to  correct  the  failure  rate  of  each  individim  ' 
part. 


STEP  7;  Determine  the  failure  rate  for  each  comjmnent.  Once 
the  correction  factor  has  been  determined,  the  preliminary  fig¬ 
ure  for  failure  rate  of  the  comporent  can  be  multiplied  by  su» 
correction  factor  to  obtain  the  component  failure  rate. 


Steps  3  to  7  can  be  considered  as’  the  most  elementary 
way  of  obtaining  a  failure' rate  estimate  for  each  component 
since  the  product  rule  has  been  usea  with  only  partial  correct¬ 
ions  considered.  For  a  better  approxlniation  of  the  true  overaU 
failure  rale-,  the  Interarfion  between  components  and  operating 
condiUons  must  be  fully  evalu.atcd  by  means  of  multivariate  anal¬ 
ysis  in  which  the  various  performance  pacameters  of  each  com¬ 
ponent  arc  expressed  as  functions  of  the  characteristics  of  the  ' 
individual  partrj  and  of  time.  .Since  those  chafaclerisllc.s  deterl 
orate  with  time  and  if  this  variation  with  time  is  known  it  is  pos¬ 
sible  to  detemilne  tnc  time  variation  of  the  performance  para¬ 
meters  cf  the  components  and  therefore  also  their  piobability  of 
failure. 


STEP  #.  Petcrmtne  a  preUmlnary  figure  for  the  failure  rate  of 
the  «<iuipmei>t>  A<U  ths  failure  rate*  for  ali 'independent  comp(Mi« 
enta  within  the*  equipment  to  obtain- the  preliminary  tigur*  for  the 
equipment  failure  rate. 

STEP  B.  Determine  the  correction  factora  to  be  Used  to  modify 
the  preliminary  fipire  for  the  failure  rate  of  the  equipment.  An 
lii  Step  6,  the  equipment  may  be  subject  to  special  atircsses  that 
have  not  been  consideied  in  the  computation  of  parts  and  conspon* 
ents  and  that.may  produce  a  change  In  the  failure  rate  that  must  . 
be  considered  at  this  stage. 

STEP  10.  Determine  the  failure  rate  of  the  equipment  Multiidy 
the  preliminary  figure  for  the  equipment  failure  rate  by  each 
the  correction  factors  applicable  to  the  equipment  to  (Main  the 
equipment  failure  rate. 

STEP  11.  Determine  the  predicted  reliability  function  for  the 
equlpmenL  The  relialiility  function  for  the  .equipment  is  given 
by;  • 

R(t)  «  e  **  (equipment  failure  rate) 

STEP  12:  Determine  the  predicted  mean  number  of  houi-s  between 
equlpment  malfuncfrons.  Tne  predicted  mean  number  of  hioura  be»  ■ 
treen  malfunctidns.  C is  given  by: 

(  •  — - —i — 

equipment  failure  rata  ' 


APPENDIX  B 


A  SUGGESTED  SYSTEM  OF  BULCS  AND  PHOCEDURES 
FOR  REUABUiTY  TESTS 


FORMS  ; 

Prior  to  the  etui  of  b  retieblittr  tost,  aR  data  lonriSjdasmcS  = 
necessary  for  the  maintenance  of  accurate  records  shall  be  agreed  ; 
upon  by  the  contractor  and  the  procuring  agency  or  the  evaluation 
group  delated  to  si^nrlse  and/or  pertom  the  test.  These  forass.' 
shall  be  laid  cut  ta  an  orderly  fashion  vlth  the  objective  of  iaaliitatn> 
Ing  accurate,  sequential  recordings  that  will  permit  r;q>ld  evaluation 
of  results  on  completion  of  the  test.  If  data  Is  kept -In  thia  mannery 
It-vill  automstlcally  be  In  such  form  as  to  enable  the  cootrador  to. 
evaluate  the  test  results  for  condiiiorui  requiring  corrective  sctlon.  * 

It  is  not  practicable  to  establish  atandard  data  lorsui  which 
would  be  applicable  to  the  wide  variety  of  clecthMle  equipment  pr^ 
sently  In  development  or  to  be  developed  hi  the  future.  However,  ’ 
the  similar  conditions  attendant  with  all  reliability  tests  do  penmt 
the  establishment  of  certain  general  forms  conside  red  to  be  neees*  . 
sary  in  order  to  maintain  adequate  teat  documentation  and  Insure  ' 
proper  tost  conduct. .  ' 

The  following  forms  shall  be  lia^ 

(1)  Test  Data  Log 

(2)  Operatora.  Log 

(3)  ■ .  Equipment  Failure  Log  . 

{<)  Failure  Dlagnosia  Report  '  -  - 

A  genera!  description  of  each  of.  these  forms  foilowR.  It  is  re* 
commendrti  ?ha»  ’hey  be  prepared  or.  a  form  .suitable  for  reproduc* 
tton  such  that  ori^nal  data  entries  will  not  have  to  be  re-copies. 

The  exact  format  may  be  arranged  to  suit  individual  requirements. 

TEST  DATA  LOG 

The  Test  Data  Log  should  be  designed  to  permit  data  entry  to 
chronoloKicai  order  such  as  io  provide  a  continuous  record  of  the 
teal  specinrjen  and  test  facility  ^Mormance  includi:^  time  required 
for  iesr  specimen  maintenance,  it  provides  moans  to  cross  check 
for  the  exi-stence  of  any  failure  i.oadveriently  omitted  from  the  Fail¬ 
ure  L-'>g.  Further,  it  provides  means  for  at  bitrating  any  contention 
that  observeo  equipment  failure  was  in  truth  the  fault  of  the  test  fac¬ 
ility  rather  ihan  tne  test  soectmen.  It  also  establishes  the  presence 
.if  .viieratirg  personnel  on  the  desired  routine  basts  throughout  the 
duration  of  the  teat. 


The  heidtng  of  the  Teet  DaU  Log  ehould  coefadAtlie  tdenuflea-, 
ticn  of  the  test,  identiflcatiou  of  the  equipments  under  test,  snd  Idea* 
tlltcstioo  of  the  various  pieces  U  ’tcst  equipment  used  in  the  test  the* 
lUty. 

AU  test  facility  and  test  specimen  parameters  that  are  monitored 
on  »  Periodic  basis  shuuld  be  entered  chropologfesUy  in  the  body  of 
the  log.  It  is  recommaided  that  the  body  of  the  log  be  iitldd  Into  lines 
and  columns  so  that  aU  parameters  measured  at  any  given  time  slC 
occtq}y  one  line,  irtth  each  parameter  being  entered  In  Its  respective 
column.  AU  columns  sliould  be  appropriately  btled  to  identify  the  . 
parameter  entered' thereunder.  Columns  should  also  be  provided  lOr 
enieririg  the  date,  Urns  and  IntUals  of  the  recorder  for  each  entry*  If 
the  pumber  of  parameters  to  be  monitored  Is  cxeeMlve,  it  msy  be  ad* 
Tieable  to  have  two  separate  loga,  one  lor  recording  teat  facility  par* 
ameters  sad  one  for  equiinaent  under  test. 

It  Is  recommended  that  log  entries  be  made  on  a  periodic  beats 
rather  than  continuously  monitoring  the  faeUity  and  tecordlsg  only 
on  occasion  of  Irregularity.  Periodic  entry  nil  provide  a  permas* 
esc  record  of  cxilt  Urjde&cim.  Is  this  respect,  it  ts-slso  recommend* 
ed  that  numerical  data  ee  entered  rather  than  a  check-mark  sotstlon 
indicating  in-toleraace  eperaUoa. 

OViBATOTta  LOO 

The  Operator*a  Log  should  be  designed  to  permit  recording  by 
the  lest  operator  of  any  Itdormatlon  relevant  to  the  test,  such  as  re* . 
placement  of  test  eq<ilpment,  deviations  irom  normal  test  procedure 
or  conditions,  visual  evidence  of  test  facility  or  test  specimen  ab*  ’ 
nomaUty  that  would  not  be  covitred  in  the  Test  Data  reasons 
for  test  tnterrupUocs,  etc.  Each  entry  pertaining  to  a  test  devtatlon 
should  be  signed  by  the  properly  authorised  delegate  of  the  evaluation 
grotqi  as  lodlcatios  of  agreement  with  the  deviatioo.  In  this  manner, 
the  compleisd  Operators  Leg  will  serve  so  official  agreement  as  Is 
proper  conduct  of' the  teat  as  well  as  providing  an  official  record  of  - 
all  significant  events. 

The  beading  of  the  Qper^rt  Log  sbou.sf  contain  the  same  in* 
formation  as  the  Teit  Data  Log  heading.  The  body  of  the  log  should 
be  ruied  with  bortroctai  lines  such  that  the  operator  can  make  neat 
lorg.ha4iu  entry.  All  entries  shall  be  made  In  chronological  order 
with  dale  and  recorders  Initials  aflUed  to  each  entry. 

Conaideratloa  may  be  given  to  combining  the  Test  Data  Log  and 
tho  Cperalors  Log.  A  combined  1{^  of  this  nature  couid  be  of  the 
gener.!!  form  herein  described  lor  the  Test  Data  Log  with  an  addl-  : 
tlonal  column  on  the  right  of  the  sheet  provided  lor  entering  remarks. 
However,  experience  on  a  •Imitar  tertbig  program  has  indicated 
that  explanatory  remarics  are  frequently  required  and  tend  to  be 
rather  lengthy,  recptirlng  more  space  tian  irould  be  conveniently 
a7ailn.bic  in  the  combined  log.  I  or  this  reason,  the  use  of  two  togs 
Is  recommended. 


EQWPMEWT  FAILURB  IX» 


Tht  Sipiipment  Fallur*  Lu(  Is  a  form  Into,  jed  to  eonteln  idl  of 
the  infonaetloo  needed  to  reach  a  declaloa  as  to  whether  or  not  the 
tested  e(!Lipmfflt  paaaee  or  ialle  the  tcsL 

The  headli!^  of  the  Failure  Lo(  ahouid  contain  identtflcafioa  of 
the  test,  identtllcaUon  ol  the  e^apmest  under  test,  aad  tuunc  o^ttle 
data  recorder. 

The  body  of  the  EQuipmeid  Failure  Xjog  should  be  ruled  Into  Uie 
necessary  number  of  columns,  seven  (7}  c-jlumns  being  required  for 
the  slmultsneous  tea**  of  two  ei^paents.  Each  addition  or  redue* 
Uon  of  equipment  wlU  require  toe  addition  or  deletion  rhspecUvely, 
at  one  column.  The  columns  should  be  head^  in  accordance  with 
the  follow*ng  list: 

(1)  Line  Number 

Consecutive  number  of  fallert  observed,  ' 

.(d)  Date  and  time  of  failure  observaUon, 

*  (4)  Aeeumutated  operating  tlma  on  equipment  #1  at  tiue  -■ 
failure  in  column  was  observed* 

(S)'  Same  as  for  equlpmeid  #3. 

(Q  Total  at  columns  4  and  S. 

(7)  Column  4  divided  by  contract 'apecifledMTBF  (lids  ' 
figure  will  be  '‘nonnalUed  time**  as  used  In  TaUe  1, 

-  Column  1.) 

Under  (he  column  headings  die  form  should  be  ruled  with  a  nne- 
ber  of  equally  spaced  horizontal  lines,  with'  sufficlept  spacing  to  per¬ 
mit  each  line  to  be  used .  'eyinte  equipment  failure,  m  egitjr 
shall  be  made  at  the  occi>  of  each  apparent  equipment  failure. 

If  failure  dlagnOBls  reveam  the  test  specimen  was  not  at  fautt, . 
the  entry  may  be  struck  out  and  ia-ttaled  the  i^ratdr.  Jifiproprt^ 
ate  o;q)ian3ilo;i  shall  be  entered  In  the  Operate:.* 

FAILURE  DIAGNOSIS  REPORT 

A  Failure  Diagnosis.  Report  shall  coidaln  all  pertinent  Infoma- 
tion  bearing  on  an  apparent  test  specimen  failure  as -necessary  to 
isolate  the  discrepancy.  If  the  discrepancy  is  found  to  be  in.  the  test' 
specimen,  additional  information  si*alJ  be  iticliK,ed  ejqplalnlng  the 
cause  cf  the  discrepancy  and,  where  appropriate,  proposing  correct* 
ive  action  to  prevent  its  rccurre,ice.  It  Is  Intended  that  a  separate 
Failure  Diagnosis  Report  be  filled  out  for  each  'apparent  test  spec!-, 
men  failure  except  those,  such  as  operator  errors,  that  are  readily 
demonstrated  to  be  not  asioclatod  with  the  equipment  under  lest. 

The  Failure  L'i.'ignosis  Report,  whsw  filled  out  and  Signed  by  the  pro** 
perly  authorized  delegates  of  the  contractor  and'Oie  evaluation  group 
shall  constitute  c£flcial  agreomeni  as  to  the  assignment  of  a.n  appar¬ 
ent  test  spoclnien  failure  Into  lU.  proper  caicgory,  either  test  speci¬ 
men  failure  or  otherwise,  as  the  case  may  be.- 

The  Failure  Dlagno-dii  Report  sh.ill  contain  two  major  sections. 
V  e  first  section  shall  pertain  to  tl.c  failure  e>'m.ntoms,  diagnosis 
action  taken,  identification  ot  tiie  dier-epxncy  ar-d  repair  of  the  spec! 
tr.e.'i  (providing  a  dlFcrepant  coraiuion  is  loured  to  exist  In  the  test 
specimen).  This  .section  of  the  Falla,-c  Diagnosis  Report  will  ba  re¬ 
quired  for  all  apparent  test  specimen  faitures  a.-.d  its  furoiat  should 
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! 


.  I 


lie  eataUlahed  prior  to  b«gi3ntn((  iho  ImU  The  aecoRtf  aeetton  of  the 
report  wlil  be  reo.uited  ooty  in  the  case  of  verified  teat  apecimen  fall* 
urea.  It  shall  pertain  to  analysis  of  failed  componentSt  analysis  of 
.  cause  nf  (allure,  and  propoeala  for  corrective  action.  tTie  amoont  of 
InfonnaUon  contained  in  (hie  section  of  the  report  uil]  vary  widely 
dependintr  on  the  coinpls.Tity  o!  th.c  cpccltnen  failure.  It  Is  recoct* 
mended  that  no  forma)  format  be  established  for  this  section;  rather, ' 
tte  sertion  should  be  composed  of  separate  reporta  ccnrering  (ailed 
component  analysis,  e^uipthcnt  design  investigations,  and  corrective 
action  proposals.  Details  of  the  information  io  be  contained  In  both 
sections  of  the  Failure  Diagnosis  Report  are  tts  follows: 

•  Section  One 

This  prepared  form  shall  contain  printed  spaces  at  the  top  with 
'  suitsble  iottrucUons  for  inserting  the  following  information: 

(a)  Failure  Diagnosis  Report  Number 

(b)  Test  Identification 

(c)  Test  Specimen  Identification 

(d)  Date  of-Appitrent  Failure 

(e)  Total  Test  Time  on  Test  Specimen  When  Apparent  Failure 
Was  Detected. 

(f)  Sequential  Test  Failure  Number  {if  ihe ‘apparent  failure 
proves  to  be  a  test  specimen  failure). 

Selow  tide  heading  Information  shall  be  four  separate  sub'SecUons 
as  follows: 

5-1-1  Symptoms  .  .  • 

This  section  shall  be  (IDed  out  by  the  test  operator,  .fully  des* 
eribing  the  symptoms  of  the  disciepuncy  including  bo^  normal  and 
abnormal  performance  parameters,  and  referencing  the  test  se* 
quence  In  citect  at  tltc  time  t‘i«  discrepancy  was  detected. 

S.1.2  Diagnosis  Action  Taken 

This  section  shall  be  filled  out  by  the  person  ‘performing  failure 
diagnoets  and  shall  include  verification  of  U«e  origlnuUy  observed 
symptoms,  a  description  of  the  test  methods  used  in  performing  fall* 
ure  diiuaicsls,  and  numerical  data  on  all  ‘performance  parameters 
checked  during  diagnosis. 

.  .8.1,5  Identlftcation  of  Discrepancy 

Thle  swtion  sh-iU  be  fUied  out  by  the  person  performing  diag¬ 
nosis  and  shall  list  the  dcf'icUve  **  or  Items  causing  the  dlncrcp- 
anry.  II  the  olecrcpancy  is  found  to  be  In  the  test  specimen,  a  dcs- 
erSpUon  cf  the  dlecropam  cor.ditioti  ol  each  defective  item  snail  be 
included.  Tnia  sh.atl  include  both  rtsually  detectable  attributes  and 
mesoured  p’rametrre,  {t.c.,  resistor  cracked  and  mensares  open). 

In  the  case  ol  test  ppccUnen  lail'ares,  c.'ich  ri'screpanl  Item  shall  be 
clussUicd  ea  e!t.her  s  prltnaiy  or  secondary  failure  {see  "Rales  lor 
Data  Ir.tc-ipretaUon"  for  dciln'.llons  of  prl-mary  and  secondary  failure). 
Each  prftuary  faHurc  .'Jhidi  be  ■^nii.ncd  a  eeounnUal  muaber  and  the 
Duin‘03r  shall  b?  Ins  arted  In  the  prescribc-d  block  at  the  top  of  the  ire* 
port. 


8.1.4  B:^r<Xap*ctBMp 

^hir  Me*loB  AhaH  &•  filM  eo*  bjr  peraooBel  la  tha  repair  acHv* 
Ur.  the  ttcait  reeled  aixt^or  the  coodltioee  repaired  le  the 
t<wt  epecimen.  A  al  the  paet  hiftory  oi  anjr  replacement 

porta  (new,  buraed  tn.  azraeraAtre  Cfcled,  «e.}  together  with  the 
idestltytng  nomenclars'^  icimtit  atmhol)  tad  the  aerial  number, 
date  code,  etc.  d  the  part  t:  r^tlaeea  shall  be  toclailfti. 

Spaces  should  tiro  he  provided  at  the  foot  of  the  form  for  algon* 
ture  of  contractor  and  cvn-srlcs)  grotm  represestatives,  aignlfylns 
agreement  vnih  the  iisfxea  aM  classlftcaliOQ  cl  primary  ttnd  see- 
-  coiarv  latluree.  (It  te  recemmeoded  thet  the  evaluation 

grcup'haw  a  tcchturiHr  ccir, 'cleat  repreaecuiive  in  attendaoce^uro 
is^  all  failure  dia^txn;-  aettcUT.  Thie  L2  the  best  way  to  ioaure 
igreemeni  on  dtaonsjs-  H  this  la  not  dmte  it  stay  be  accessary  to 
provide  cooatder^T  z»tr«  docamentation  of  the  magnoala  activity.) 

S.S  SectianTwo 

Thla  acetioa  ehalt  h«  ft:spc«ad  of  the  repoita  tmteoae  aupple* 
Bieetary  Invcstipatrs:;;  asd  aralvai#  as  i&ay  be  ttqaixti  to  determlno 
the  type  of  corrective  t^x.  seeded  to  prersst  rceitnence  of  observed 
test  epectmea  failures.  £a  peuenl;  a  mlnimam  of  three  icpotto  will 
be  required,  aa  foUews: 

5.1.1  AriIvsIs  cf  Failed  Coccpmgt  Report 

Thle  report  may  be  rrrcarvd  on  aay  appioprlate  format,  I.e., 
forsa!  test  report  ccetpaty  i-tetr.ol  corrcspcndenc^  company  memo* 
ra-vlum,  etc. ,  but  atsc-il:  ce  readily  reproducible,  r  shall  be  pre¬ 
pared  by  the  per&oc  perters:::^^  the  componen:  analyala  and  ahatt  con- 
t?da  the  following  Infcrsa&cs: 

\1)  Antroprlam  hssdtsg,  sefervmciBg  the  applicable  t^  apcel- 
men  fallurs. 

(9  Verlftcatioceffaihawdlagnoeialladlnga  aatodlaereiMud 
eoDdlttona.  ■ 

e 

(3)  Reeulta  vf  tests  performed  on  the  compooeot,  f.e.,  resis¬ 
tor  temperarart  cyciad  and  found  to  he  open-only  above  tO** 
C,  etc. 

(4)  Reeulta  cf  dUsaectfon,  if  such  ia  poaaihle,  and  mtcnacoplc 
analyeu. 

(5)  Btatemeet  sa  fo  rcselble  causative  factort,  relating  the 
normal  eqmntrett  eperaUng  conditions  ciUter  aignlllcant  . : 
or  la9lgr.:iirjcs:. 

(fl  R*-eults  of  ary  tsets  performed  on  addiUonal  new  compon¬ 
ents  to  determ_->  tee  sarceutlblilty  cf  Che  ccunpooent  to  the 
type  ol  Is-Iure  trsier  izre^U^stioa. 

(7)  Conclusttra  irtxz  ta  zo  the  orcrall  quality  of  the  compon-  . 
ent  a.nd  its  f^r  use  In  its  lete.'xled  aj^lcation. 

5,2.a  Pfsi?;  A'lalyst.s  Report 


rrJt  report  miv  £>e  prrr-jced  cn  aay  suitable,  reproducible  format. 
B  fihil!  be  requ  red  ii  mai  that  failed  COiujwoeni  analysis  cannot 


rviTMl  th*  tntf  cviae  «<  eompommt  ftlhtrc  o/ w  Dm  e^patat  fall- 
ttjK  U  caused  by  deti^  dtfleiaacy.  It  ahall  iadt  >  at  teaat  tM  toUn«. 
Ing  lafonratloa,  irhcre?«r  apiiUeabta: 

(t)  Appropriate  heading, ratarmelnf  the  applicable  teat  epeei- 

men  lallure. 

(3)  Results  'jddestgK  toleraacp  atudien,  It  this  appears  to  be 
related  to  the  equlpmant  faUure. 

C3)  Results  of  electrical  aad/or  aechanlcel  assign  studies  of 
mounting  techniques,  ports  layout,  materials  used,  etc., 
as  may  be  applicable  to  the  tmurt. 

(4)  Conclusions  draam  as  to  the  eu*tabUlt»  of  the  equipment 
design  to  perform  Its  tntonded  function  tn  view  of  the 
served  failure. 

••8*5  Correctlre  Action  Proposal  .  .  . 

This  proposal  may  be  prepared  on  any  suitable,  reproduciUte 
-  format  It  shall  be  prepared  based  oa  the  failure  dlagncsls  findings, 

-  faiUxi  component  anaiynis,  aad  design  iovesUsatlana,  and  shall  con¬ 
tain  prcpoecls  of  methods  tc  prevent  the  recurrence  of  the  observed 
'  fpiiure.  The  proposal  ehall  contain  h^sdlr^  Information  rsfereneliig 
the  •pplic-Mv  equipment  failure  aad  shsU  contain  one  or  mors  pro-'  - 
posaln  ct  corrective  aetloo,  represeutatlve  eommples  of  which  art  as 
folioffs: 

{1}  ComponedspeeltlcatloBtobsehangedtorelleetiiewtol- 
erancs  limits. 

(2)  Addldonal  tests  to  bo  added  to  eamponeat  i^ifleali.eo 
wnteh  will  effeeUvely  sort  out  defsettvos. 

(3)  Specify  dlfterent  materials  to  bt  need  In  cbiutrttetl.v;  of 
competent. 

(4)  Chaago  pari  vendor* 

it)  Alter  circuit  design. . 

(3)  Relax  equljiment  ttpectflcaUc:2S  toward  moro  reallstto 
requiresieids. 

Each  corrective  acMon  proposal  shall  be  sdbstantlated  with  suf¬ 
ficient  titu^round  Information  and/or  datmto  adequately  verify  the 
■  effectiTSTtAss  of  the  proposal.  - 

Or*  ecsaplcUon  of  the  r^ris  required  In  section  two,  they  shall 
'oe  compiled  end  sttached  to  the  form  of  socUon  one.  This  shm'  then  ■ 
eomprisn  Iho  completed  Failure  Dlsgsoeie  Report  as  required  for 
test  fipeclmec  failures. 

*•  RtlbSS  FOR  PRCCgOUREg 

6.1  Prior  to  besinnlng  the  tfiri,  the  periodicity  fer  monitoring  test, 

fscliit:.  and  test  specimen  parEmeters  shall  bs  ostebllshed.  After 
U.e  tc-n  hi3  been  la  proffrees  for  a  roasonable  lenp+h  of  time,  test 
re'iula  BK'uid  be  sj^d  consldeniUon  given  to  eiUier  shorten¬ 
ing  or  the  period,  as  tent  conditions  Ind  cate. 

6.2  Prior  tc  beclrming  die  t«ri,  allowaMe  breaks  li.  testing  sNiuld  be 

j.  T-.*  «''.r,ald  tncbds  ■d.^'.-isions  »«  to  jx-naissaSUlly  of 
one  or  lit  eperutioa,  shui  doau  das  to  wcea  eiris  ar;il  hoL'dayn,  etc. 
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8.9 


8.4 


8.$ 


8.8 


8.7 


8.8 


psriodie  (or  toot  ototteo  eoUbrotton  ototld  bt  oolidb* 

Uohrj  prior  to  th«  oUrt  ct  tho  Uet  Z}o«mr»  no  toot  spoetafton 
•hould  bo  per.«Utaa  (or  toot  oqoipnoat  e«t«o(»tolonaeoo  oe^urtnf  . 
betovoa  cchadolad  eoIlb*^OQ  ponodo.  •  *- 


The  coatroctor  Is  oilOved  to  perform  any  neccooary  debucxtiif 
and  tesuns  on  the  test  specimen  prior  to  the  start  at  the  test.  Optr*  ■ 
atli^c  time  so  accrued  shall  nsH  be  counted  as  test  ttmo.  * 

In  initiating  the  test,  the  teat  specimen  may  be  operated  In  ttit 
test  facility  (or  a  sulficle.nt  length  ct  time  to  Insure  proper  opera* 
tlon  and  calibration.  Operating  time  so  accrued  sluul  not  bt  eeuntsd 
as  test  time.  Any  specimen  failures  occurring  during  this  period 
shall  iiot  be  counted  as  test  failures. 


If  the  test  facility  (nils  during  the  course  of  the  test,  it  is  reeom* 
merdfd  that  the  test  specimen  be  replaced  with  similar  e<{aipmcat.hot 
unoer  test  if  such  is  needed  for  proper  diagnosis  of  the  test  facility  :, 
failure.  If  no  ether  equipment  is  available,  the  teat  specimen  may  bo' 
used  but  time  so  accrued  shall  not  be  counted  as  test  time  unless  ihis  , 
representative  supendsing  tne  tesu  agrees  that  tesi%ondlUons  arb  ’ 
reasonably  repreaemativs  of  r-ormal  •^quirements.  However,  any.  ' 
test  specimen  failures  that  occur  dunng  this  period  siust  be  counted 
as  test  failures  unless  it  rain  be  adequately  verified  that  the  fallurS'  ' 
was  due  to  abnomsu  conditions  existing  in  ths  test 'facility. 


Preventative  maintenance  t  n  the  test  specimen  shall  not  be  al*  V 
lowed  unless  s.^eclflcally  calltv  ior  in  tl"  contract  with  respect  to 
this  test.  Adjustment  of  operator  controls  la  not  coostdered  prevent* ' 
Ive  malntenarne.  Anticipation  of  failure  shall  not  h*  jusUftcatictt  for 
preventive  maintenance. 


It  is  permlssable  fbr  the  repair  activity  to  operate  a  repaired  ' 
test  specimen  fo;:'  any  length  of  time  necessary  to  verity  the  correct-  ' 
ness  of  diagnosis  end-  repair.  - 


Any  operating  time  so  accrued  on  the  t«Bt  speeimtn  shall  not  bjS  > 

,  counted  as  test  time  under  the  representative  supervising  the  tests*  ’ 
agrees  that  test  conditions  are  rc'usonably  representative  of  normal  . 
roi'*irt»en*2.  Ilnvover,- feJlures  occuring  during  this  time  shall 
be  counted  as  test  failures, 

8.8  Before  replacing  sny  parts.  In  a  test  j^lmen,  authoirtxaUoe 

mut.t  be  obtained  from  the  cognisant  representative  of  the  evaluation' 
agency. 

7.  RULES  FOR  CLASSJFYtNQ  FAILURES  *  *  ^ 

7.1  An  app.arent  test  specimen  failure  tJ«u  is  reported  by  the  <H)era-  ' 

tor  but  cannot  be  verified  by  the  failure  diagnosis  activity,  or  that 
disappears  during  the  course  of  failure  olagnosis,  shall  be  counted 
as  a  test  failure. 


7.2  The  following  rules  ehrJl  govern  the  assessment  of  discrep.nnt 

p.'irta  detected  during  lailure  diagnosis;  (Parts  are  ctxwldersd  to  be 
such  items  as  resistors,  capacitors,  tubes,  etc.). 


(1)  Any  p.\rt  uhich  is  outside  Ita  specification  tolerance  but 
does  not  cause  eqidpment  malfuiction  shall  not  be  counted  ■ 
as  a  test  failure  and  shall  not  be  replaced. 
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(19  UanequiprmentmallfiUieUoi^ldtouadtobtcftuttedbf  HfMurt - 
vhlch  is  wlUiiji  ItA  apeeUlcfttlon  tol«ninc«i  It  •httl’.  M  ' 
counted  aa  a  teat  (allure  and  ehaU  tw  replaced.  The  eendU 
tlon  muat  be  covered  by  a  corrective  action  propoaal. 

(3)  m  the  event  (allure  dle^noale  reveala  that  more  than  one 
PUTT  in  a  (ailed  specimen  la  both  outside  apecUlcatlon  Umlta 
and  wlU  Independently  cause  ttnsatlsfaclory  equipment  oper* 
ation,  each  such  part  shall  be  counted  as  a  sepaiate  test 
failurs  unless  It  can  be  adequately  demonstrated  that  the  (au« 
ure  o(  one  pari  In  turn  cauaed  the  Immediate  or  sidMeiiuent 
(allure  d  one  or  more  of  tU  other  parts.  In  this  event,  the 
Initial  (allure,  hereafter  called  a  primary  (allure  shall  be  - 
counted  as  a  teat  (allure;  the  dependent  (allures  niay  be  elas* 
dltad  as  secoodUT  (allures  and  need  not  be  counted  as  test 
(allures. 

(4)  It  two  or  more  parts  sre  found,  either  within  speclflcatlOB.  ■ 

nr  not,  that  ioindy  contribute  to  an  equlpment  mal^metlon, 
no  single  part  being  Independently  ot  prodwiing 

cquipmeat  out>o{>toIeranc«,  ail  such  parts  shall  bo  removid 
and  only  one  test  (allure  eounled  tor  the  comblnatluiu.  De¬ 
tails  of  the  circumstances  shall  be  presented  to  the  dvelgn 
activity  lor  close  stuily  and  the  coQuiUon  must  be  covered 
by  a  corrective  action  propossL 

(5)  '  Jn  the  case  oC  mis-dlognosls  in  which  a  part  le  replaced  and 

eqi'Ipment  out-of-tolerance  ta  not  corrected  the  original 
part  shall  be  replaced.  U  the  part  is  damaged  during  rs- 
movel  and  cannot  be  replaced,  it  shall  be  counted  as  a  tsst. 
(alluie  tuiless  the  representative  supervising  the  tests  esa 
be  completely  satlnlled  that  no  attempt  la  being  made  to  rs- 
plaue  incipient  failures. 

TEST  PROCEDWRg  AND  USE  OF  FORMS 

Prior  to  beginning  the  test,  the  contractor  shall  prepare  a  detaUed 
test  plan’  and  the  necessary  c(f ictal  data  forms.  These  shall  be  ap¬ 
proved  by  the  evaluation  group.  The  contrsetor  shall  also  obtain  ap¬ 
proval  from  the  evaluation  group  of  the  test  facilities  to  be.used* 

.  When  the  approval  of  the  above  has  been  obtained  Uie  test  may 
begin.  Heading  Information  Is  to  be  inserted  on  the  Test  Data  Log, 
Operators  Log  ssd  Equipment  Failure  Log.  The  equipment  under  test 
is  then  Installed  in  the  test  facility,  and  necessary  proof  runs  are  made 
to  Insure  proper  operation  of  Uie  feciUty.  When  satisfactory  opera- 
iicn  has  been  obtained,  the  test  operator  shall  make  the  first  entry 
In  the  Test  Data  Log  and  the  teet  ehafl  officially  begin.  This  entry 
end  aU  subBeqiient  entries  in  tlio  Test  Data  Log,  Operators  Log,  and 
Equipment  Failure  Log,  eh.'’il  be  initialed  by  the  operator  making  the 
entry.  Entries  shall  be  made  thereafter  in  the  Test  Data  Log  at  the 
p.-escribed  Intervals.  Apprppnaie  entry  shall  be  mads  in  the  Oper-  . 
ators  Log  at  bitervais  of  lest  facUtty  callbrab  ni.  Wt:rn  the  first  ap¬ 
parent  test  specimen  failure  Is  observed,  the  test  operator  shall 
make,  en  entry  in  the  F.^fpment  Failure  Log,  suitable  entry  In  the 
Test  Data  Log  and  biiutue  eecilon  one  of  the  Failure  Diagnosis  Re¬ 
port.  The  failuio  diagnosis  activity  shall  be  Immediately  notified 
and  shall  verify  the  existence  of  the  discrepancy  wlUjO'it  removing 
the  test  specimen  fion:  U;»  test  facility.  If  the  discrepancy  is  veri¬ 
fied,  Uie  specimen  shall  be  removed  from  test  without  disturbing  the 
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remainttn;  rquipmenta  under  teal.  The  failure  dlagnoele  activit)r 
shnU  then  proceed  with  failure  diagnoata,  fltlUv^  out  at^Ucablt  por> 
ttona  of  the  Failure  Diagnoais  Report,  llie  repair  fctivity  ehall  per¬ 
form  required  rework  on  the  Bpecimen  and  fill  out  the  applicable  por- 
tioii  of  the  Failure  Diagnoata  Report.  After  appropriate  aignaturea 
have  been  affixed  to  the  completed  flrat  ac'stlon  of  the  Failure  Dlag- 
noala  Report,  the  repaired  apecimen  ahall  be  returned  to  teat  and 
entriea  made  in  the  Teat  Data  and  Operatora  Logs  to  indicate  aatta-  - 
factory  operation.  Failed  parte  removed  from  teat  specimen  ahall 
be  analysed  and  the  design  group  shall  be  informed  of  the  failure. 
Section  two  of  the  Failure  Diagnosis  Report  shall  be  prepared  by  the 
responsible  personnel.  If  failure  disgnoaia  reveals  that  the  observ¬ 
ed  discrepancy  was  not  caused  by  the  teat  specimen,  the  entry  in  the 
Equipment  Failure  Log  shall  be  struck,  out  and  initiated  and -appro¬ 
priate  explanatory  entry,  referencing  the  Failure  Diagnosis  Report 
number,  shall  be  made  in  the  Operators  Log.  .<11  additional  appar¬ 
ent  test  failures  shall  be  hatxlled  in  a  similar  manner.  At  the  time 


of  each  entry  by  the  test  t^rator  in  the  Equipment  Failure  Log,  he 
should  check  the  test  chart  to  determine  if  a  decision  to  pass  or  fail 
ths  test  specimen  can  be  made,  or  if  the  test  must  continue. 


■  As  soon  as  the  decision  is  made,  .either  pass  or  fait,  all  Teqt 
Logs  and  Failure  Diagnosis  Reports  shall  be  compiled  into  a  final 
Test  Report.  The  contractor  shall  include  in  the  Test  Report  a  tast 
summary,  including  evaluation  of  the  test  results  and  recomimenda-. 
tions  as  to  which  corrective  action  ompnaals  should  be  Incurporated 
into  the  equipment.  The  final  Test  Report  shall  be  submitted  to  the 
evaluation  group  for  approval. 
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ABSTRACT 


Practical  e«ans  for  parforsiof  (suantitativa  avalu*' 
tlon  of  the  reliability  of  pilot  production  and  prd'*ue‘-.ioa 
models  of  electrcnie  equipment  are  available.  These  eaa 
deterrine  conclusively  whether  or  not  the  equipment  meets  a 
specified  ainlsus  acceptability  roquireaent. 

The  testing  sethods  which  provide. epeeifie  routines 
for  {a}  reiiaciiity  index  evaluation  of  pilot  production 
equipsent,  (b)  reliability  index  evalitatW  of  productiofei 
equipment ,  and  {e}  longevity  evaluation  of  pilot  production' 
an-i/or  .production  eruipseat  are  presented.  These  test 
routines  permit,  respectively,  (a;  establishaent  of  capahll*  . 
ity  for  seetlne  siniaua  reliability  requirexent,  based  upon 
the.  greatest  testing  economy  with  respect  to  number  of 
equipments  tested  and- testing  time  required;  (b)  statistically 
conclusive  prscf  that  an'acceptnbtle  percentage  of  quantity^ 
produced  equlpcents  meet  a  minimum  reliaUillty  requlreaant»  ' 
with  caxlmus  eccr.cny  of  test  coct  and  time;. and- (c)  con-^ 
elusive  proof  teat  equipment  reliabllit^T  dees  not  degrada 
during  t>ie  desired  equipment  life  below  a  preaeribed  mlniinta 
level. 

T.he  procedures  are  daveloped  in  such-  a  manndr  that 
they  are  reescnaoly  immune  to  tampering  by  tbs  contractor 
or  by  prejudiced  testing  personnel. .  In  addition,  aaleetad  ■ 
redundancies  is  data  handling  rendar  the  testing  methods 
reassnebiy  self>e.'.ec;cing  and  Isntine  to  errors  in  data  ra- 
ccrdir.g.  Specific  means  for  aceompliehing  tha  evaluaticns 
are  described.  T.hcse  are  in  the  form  of  detailed  testing 
methods,  circumscribed  by  ecsplete  rules  for  administration  • 
and  procedure,  elective  parameter*  left  .to  the  procuring 
agency  are  cnly  those  which  must  relate  ( I)  conditions  of 
equipment  end-use  to  the  testing  procedure,,  and  (2i  con¬ 
ditions  of  procurement  volume  and  scheculing  to  the  testing 
sequence.  Factors  which  cannot  affect  evaluation  eoneluslona 
but  can  affect  testing  convenience  ore  le.^t  for  election  by 
the  procuring  agency  or  the  contractor." 

Reccmcemdations  for  a  program  of  implementation' 
are  offered. 


X.  xmomcTioi 


A.  StataMnt  of  Nlotlott 
1.  Cenoral 

ACHES  Took  Croup  So.  3  woo  dlroetod  to  dovolop  b*«le 
requtroMoto  for  a  quaatitatlvo  oTalaatton  to  bo  aeeoapllohod  ■ 
OB  pilot  productloB  aad  product loa  awdclo  of  oloetroBie 
aqulfoiont  idiieh  will  prove  eoneluaivolp  that  tha'  aquipacat 
trill  Mat  tho  BiBiaua  aeeoptabilitp  flgura  for  rallabllitf 
aatabliabad  for  tba  aqaipooBt  typo.  Tba  dlroetiva  provided  ■  - 
that  thia  ovalttatioB  abould  ba  dati|>aad  to  bo  porfonad  atthar 
la  additlcB  to  or  la  eoBjunctloa  with  (but  not  la  liaa  thara* 
of)  trhatovor  parforaaaca  avaluatloea  aad  oporatioaal  .aaitabllitf 
avaluationa  ara  apoelflod  for  tba  aqaipMat. 

•*  • 

Ona  of  tha-  finit  fuaetloaa  of  tba  Taaa  Croup  traa  to  ' 
latarprat  thia  dlraetiva  in  tana  of  a  daflnitiva  atataaaat  of 
Ita  •ioaloB.  Thia  traa  oriclnally  atlpalatad  la  tha  ainutpa 
tha  Third  Meatlaa  la  ipril.  1956.  -Thia  aiaaioa  in  fieal  fora 
follqtrs:  .  .  .  . 

It  la  tha  aiaaioa  of  tha  Tank  Croup  to  fonhilata 
a  body  of  rulaa  which  abould  govant  tha  aatarial  , 
aarvicta'of  tha  ailltary  la  tbf  tachnlcal  aapacta 
of  apacifying  rallablllty  avaluatioa  roqulr^ata 
for  ailltary  alaetronlt  aqulpiaat  preeuraaaat; 
particularly,  thia  Taak  Croup  la  coneamed  with, 
tha  cvaluatloa.of  aqutpMnt  rallablllty  la  pilot- 
■  production  and  production.  ' . 

A  nuabar  of  aora  detailad  criteria  govamlng  tha  aatura 
of  tha  rulaa  ware  agreed  upon.  Tbaaa  tacluda  iaportantly  tba 
following; 

(a)  ■  They  shell  U.  a*‘baittad  in  a  fora  auitabla 

for  ioaediata  applicatioa  by  the*  proeuiriag 
aarvlea. 

(b)  Their  applicability  shall  be  suitable  for- 
extension  to  all  ailltary  electronic  ayateae 
and  equipment  procured  in  pilot,  production 
and  production  quantJLties  by  any  of  the 
services. 

(c)  The  principles  reflected  therein  shall  be 
sufficiently  basic  so  that  their  applicability 
shall  extend  squally  aaong  variations  in  type, 
applicati'..-!,  cone'’.r»*.ction,  end  production 
nethods  and  so  that  it  shall  Insofar  as  poa- 
slbie  e.ieure  independently  of  the  state-of- 
the-art  lo  electronic  equipoent.  The  advent 


of  itiprovod  ttehsiqms  and  procoduroa 
apptroprlate  to  tho  doterniiMtios  of  r«> 

.  .  llabilitjr  in  pilot  proubction  and  produetior. 

•qulpaens  saj,  of-eour**,  lead  to  paflnecent 
or  change* 

(d)  While  the  evaluetion  tcchn'iquea  and  procedure* 
are  to  be  explicitlr  specified,  and  .biclcground 
saterlal  'sh»il  te  included  to  pemit  altera* 
ticn  of  the  data  evaluation  aethod  and  the 
acceptar.ee  criteria  recomended,  sufficient 
basis  shall  be  provided  -to  govern  the  aeleetion 
of  procedure  and  conditions  by  the  procuring 
agency  to  aptly  suit  the  type-  of  equipment 
{and  its  application)  to  be  evaluated*. 

2.  Definitions  and  Related  fhUoeojdqr 

To  provide  unanimity  of  purpose  and  sound  understand* ' 
ing  within  Task  Croup  Wo*  3  it  was  found  essential  to  redefine 
certain  applicable  terns  with  respect  to.  the  task  mission. 

Most  basically  it  was  necessary  to  specify  definitions  for 
equipment  reliability  and  its  antitbasiap  equipaant  failura 
probability,  which  would  ba  suitabla  to  all  raquiremants  of 
the  assigned  mission.  Table  1  provide*  a  list  of  dafiaitiona 
adopted  by  this  Task  Croup. 

Sine#  aquipaent  reliability  can  ba  conveniently  ex* 
pressed  as  a  probability  of  desired  operation  without  failure, ' 
prediction  of  the  pattern  of  equipment  .^allure  occurrence* 
during  the  useful  lifs  span  bseomea  esssntial  to  reliability  da*  .  . 
taraination.  The  observation  of  newly  produced  aquipmant  tub* 
mltted  to  synthesisad  eocditlcna  of  ultimata  use  persit*  notatioa  - 
of  the  tines  .of  occurrence  of  failurM.  Theta  data  can  .mvtda 
suffioiently  accurate  measure  of  the  intrinsic  failura/tims  ' 
pattern  to  permit  useful  datamination.  of  rallabiXity  index.  To  .. 
establish  props**  basic  references  equipment  failure  la  herein 
defined  a*  follows:  *  ' 

An  equipment  failure,  during  pilot  production 
or  production  reliability  evaluntlon,  ia  the 
cessation  of  the  equipment's  abili^  to  meet 
minimum  performance  specification  Imposed  by  . 
contract.  .  Adjustment  of  operator  controls  ia 
allowed  to  any  extent  necessary  to  mainea:<)' 
specified  perfor^ocss,  and  such  adjustment 
spfll  not  in  itself  constitute  a  failura; 

If  the  minimum  performance  specification  imposed  by 
contract,  and  applicable  to  the  above  definition  of  equipmrnt 
failure,  differs  appreciably  froa  that  minimum  performance  es* 
sentlal  to  any  particular  field  condition  of  op<trationel  use,  - 
the  operational  reliebility  of  the  equipment  obaerved  during 
field  use  cay  be  signlf'cantlv  different  from  the  reliability 
predicated  on  pilot  production  or  production  tests.  While  it 
Is  desirable  that  .the  latter  prediction  yield  s  reliebility  ' 
index  suitable  for  oomputation  of  Inherent  equipment  relia* 
blllpy,  ar.d  thus  useful  to.  estentlsDy  all  varietlec  of  opera¬ 
tional  use,  it  Is  Imperative  that  the' minimus  porfonsance 
specif ic»  f ion  Stposed  by  ecr.trset  for  use  in  the  reliability 
testing  described  herein  be  realietica^y  limited  te  a  minimum 
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TABLE  1 


1  J)E»I«T10BS 


EQUIPMECT  Aa  equlpBeat  is  a  fixed  nusber  of  itaas  idiieh  ara 
required'for  the  parforsaaca  of  a  coaplata,  apaeifie,  opara- 
tional  function.  —  • 

SYSTCT  A  syatsffl  Is  a  frcup  of  equipnents,  including  ang 
required  operator  functions,  which  ara  intagrated  to  parfoni 
a  related  operation. 

PILOT  PRODUCTION  Pilot  production  la  the  initial  poet- 
tooling  production,  the  pris«rp  purooaa  of  which  ia  to  prov 
the  ccpability  of  the  tooling  and  production  llna.  . 

E9mPM£?»T  PAILUSg  An  equipsent  failure  during  pilot- produe* 
txon  and  production  ia  the  eeaaatica  of  abilltp  to  sMat  that 
.-nininua  performance  acecificaticn  essential  .to  aatlafaetorp 
application,  further,  equlpcent  failure  ahall  Inply  that 
the  ainiaua  acceptable  perfersance  apaclfied.for  the  ap» 
plication  la  not  raubtaisal-la  through  peralasibla  raad^iat- 
sent  of  operator  controla. 

EARLY  PAILURg  PE.ycc  The  early  failure  period  of  an  aquiment 
Is  that  period  of  equipccr.t  life  .starting  just  after  final, 
assenbly  where  equlp&snt  failures  occur  initially  at  a  higher 
than  noraal  rote  due  to  the  presence  of  dafactlVa  part*  and 
abnormal  operating  procedures.  Also  called  tbs  *da»buggiag* 
or  "burn-in"  period. 

>:0R?1AL  OPSRATI^  PERIOD  The  norsal  operating  period  of  aa 
equipaent  io  that  period  of  aquipaent  life,  during  wbiefc  the* 
aquipnent  failure  rate  resalns  eesentlaXly  constant. 

VEAROUT  PcHIop  The  wsareot  period  of  an  aqulMmit.  ia  that 
period  of  equipment  life,  folicwlng  the  noraal  operating 
period,  during  which  tbs  equfpcent  failure  rats  inersasea 
above  the  normal  rate. 

EC!!flPM£*rr  LCllGSYITY  Equlpcent  lonfevlty  la  the  length  of 
the  noraal  operating  peried  of  equlpcent  life.  The  beginning 
of  equipment  longevity  usually  occurs  when  the  equipment 
failure  rape  duri.ng  the  early  failure  period  drops  suf¬ 
ficiently  low  to  be  within  and  resaiu  wiihln  specified  limits 
and  usually  e.ids  when  the  equiccent  failure’ rate  rised 
etove  the  specified  llalt.,carsir.g  the  beginning  of  the 
wearout  period.  Longevity  can  be  specified  either  in 
terms  of  equipment  hours  of  operEtion  or  valvndar 
time  of  equipment  life.  In  the  case  of  the  latter,  tha 
number  of  equipment  operating  hours  tc  be  expected  par- 
unit  of  calendar  time  Is  an  important  consideration. 


TABLE  1  (eontliMMd) 


RELIABILIIT  BelUblllty  l«  th«  prcbaMllty  of  fiarforalBg 
without  X^allur*  *  specified  function  under  given  condition* 
fcr  e  specified  period  of  tiae. 

IKHSam  Ra.IA31LITy  inherent  rellnbllity  is  the  probebil* 
Ity  of  pcrforsiag  without  feilurs  a  specified  function 
under  specified  test  conditions  for  a  required  period  of 
tine, 

EOUIFMEWT  RSLUSIIITT  Squipucnt  reliability  is  the 
probability  of  perfenaieg  a  specified  function,  under  given 
conditions,  at  a  aeaaured  reliability  index  (average  failure 
rate  in  te^as  of  its  reciprocal  aian>tlB««b*tweao>failttr**) 
end  for  A  ««*surcd  oauipsant  Icngevity  (tbo  total  pariod  of 
tine  during  tdiich  this  quality  Is  nalatalnad), 

RELIABILITY  IK3EX  Roliabillty  indsx  is  that  avaraga  aaasnra 
of  tha  equipeent  failura  rato  (uaually  obtainad  during  tba 
nonsal  opersving  period  of  o<piipaent  llfo)  oxpresood  in 
teraa  of  "Eean^tiso-betwoen'failuraa”  (XtBT  or  T) *  Onlesa 
otherwise  stated,  tns  convsnclon  is  that  tha  neas  aquipaont 
operating  ties  between  failures  la  naant  by  *MaD»tl]M* 
between-failurea .  ■  •  •  . 


n~:«sr  c.  psr.crcane#  eh«rAet«ri»ttef  r#»dHy  b» 

op««ting  parionnel  such  that  •raluatien  ttehiilauct  »r«  nftt  ' 
cu®bertoB«,  Thj  Mllablllty  Index  ie?i»ed  srnet  permv  ealeul*- 
tlon  of  Inherent  equipoent  reliahlliT  that  U  neither  mieh 
tilgher  nor  much  lower  beeeuee  of  difference  •  in  perforMree 
erlterle  tl^  everegt  eperetlontl  rellehlirty  «b* 

eerwed  during  field  uee,  Coespllaree  with  thle  phllotophy  will 
per^t  ready  and  valid  eeaparlaon  between  teat  Indleee  on 

?•  ••  eo^Et^rlaena  between  teat  Indieea 

and  field  obeervatlona,  • 


The  basic  motive  of  the  task  aieslon  la  to  provide 
means  generally  effective  In  preventing  equipment  below  ee« 
looted  minimum  reliability  requireaenta  from  raaehlng  the 
field.  Accordingly,  the  evaluaticn  aethoda  proposad  peneit 
evaluation  of  the  failure  rata  (and,  ccnvorsaly,' Its  re«  > 
elprocsl,  nean*tloe-batwaen>fallur<t'  versus  equipment  age. 
Since  the  basic  desire  is  to  recognise  equipments  whose 
failure  rate  ia  too  high,  either  initially  or  prior  to  the 
end  of  e  selected  and  pi  escribed  life  duration,  it  ta  eon* 
venient  to  illustrate  thld  type  of  failure  rate  versus  life 
ehsraetsrlstic  which  must  be  reccgnised  through  the  evslua* 
tinn  procedure  described  and  recommended  heroin. 


Figure  1  Is  idealised  to  esrhasite  that  the  general  . 
life  characteristic  should  be  considered  with  respect  to 
3  phaaee,  which  are  identified  as  the  early  failure,  normal 
operating,  and  wear-o«»t  periods.  Perhapa  the  most  important 
liberty  taken  In  using  a  smooth  curve  such  as  that  of  Figurs 
1  for  Illustrating  the  failure  rate  life  charaet eristic. 

Is  that  ths  smooth  failprs  -ratt  Laplies  that  fsilurea 

occur  St  uniform  tims  intervals  of  either  constant  value  or 
of  uniformly  charging  value,  whereas  in  actuality  the  fall*  *  ; 
urea  (of  interest  to  this  discussien>  occur  randomly  in  time,  . 
and  it  is  the  value  of  their  average  occurrence  interval 
that  has  been  used  to  compute  the  failure  rate  illustratsd,  ,  ■ 
Since  averaging  requires  group  consideration  of  a  number  of  - 
failures  (rather  than  one  or  two),  one  must  collect  such 
ftilurs  groups  over  s  period  of  time  (which  may  beecre 
significant  with  respect  to. the  tims  ecale  used  in  Figure  1), 
cr  one  must  collectively  use  data  from  a.nuabtr  of  ths  asms  • 
type  of  equipments  under  like ’ConQic:.cds  and  exiiibitlng 
like  characteristics  (though  not  cetiisarily  exJilbitlng  ■  ' 

slmilteneous  failure  oceurrenees. 

Operating  time  accumulated  crier  to  delivery  by  the 
manufacturer,  combined  with  the  inherently  lower-slope  por¬ 
tion  of  the  initial  portion  of  the  failure  rate  time  curve 
may  prevent  the  equipment  user  from  rvccc.nlslng  the  existence 
of  the  early  failure  phase,  Equitcent  oosolescence,  or  • 
perhaps  un.-opairable  major  failure  msv  crevent  service  us# 
into  the  actual  wear-out  period.  Tr.e  basic  Interest  cf  the 
task  misalon  with  respect  to  failure  rate  during  a  prescribed 
interval  of  equlpf!.ent  operation  (desired  useful  life)  , is  in 
the  devolopment  cf  means  for  dete.-mirirg  that  no  retcgnitabl# 
circumstances  can  or  will  exist  to  rersrt  signific.^nt  increase 
of  failure  rate  belore  the  elapse  c*'  t.'S  life  period.  Ac¬ 
cordingly,  the  life  characteristic  fs  illustrated  by  Figure  1 


FtKurc  1 .  Equi)^««nt  Eifc  Ctwr*c^riat|c*—Tbc  Rctiabitity  Fuactioft 
.  Under  Cmstaat  Enrirenn^tal  0|^r»tir<g  Cpsditioar. 


Is  most  sultsbls  for  lllustrstln(('  the  oonslderstion  «hleh 
has  been  given  to  the  evalustlon  procedures  recommended  here¬ 
in.  Figure  1  shows  that  the  failure  rate  (X)  with  reepeet 
to  tine  decreases  during  the  tine  0  to  A,  Tenelne  esMB- 
tially  constant  during  A  to  B,  and  .Incrcaoea  beginning  at 
time  B.  These  three  phases  or  periods  of  time  are 
correspondingly  called  the  •’early  failure",  "normal 
operating",  and  "wear-out"  periods. 

The  early  failure  period  (0  to  aUs  that  period 
which  (when  its  existence  can  be  detected)  begins  at  tha 
first  point  during  manufacture  that  total  equipment  opera¬ 
tion  is  possible  and  continues  for  such  a  period  of  time 
as  permits  (through  maintenance  and  repair)  the  elimination 
of  marginal  pait'r,  initially  defective  though  not  inopera¬ 
tive,  and  unrecognisable  as  such  until  premature  failure. 

Upon  replacement  of  all  such  prematurely  falling  items,  tha 
failure  rate  will  have  reached  a  lower  value  (point  C) 
which  will  remain' fairly  constant  and  which  defines  tha 
beginning  of  tha  normal  operating  period.  Because  customary 
curve  smoothing  techniques,  necessary  to  develop  an  averaga 
from  rs  ■  ■  .a  data  points,  markedly  reduce  the  accuracy  with 
which,  a  •  )int  of  Inflection  can  be  located,  it  la  probabla 
that  sora*  aifficulty  may  generally  be  encountered  In  de¬ 
termining  the  abcissa  (time.)  location  qf  point  C.  Howevar, 
once  the  failure  rate  falls  below  the  allowable  Maximum, 
specified,  a  precise  determination  of  the  time  location  of 
point  C  is  of  secondary  interest,  as  the  failure  rata  will 
not  be  expected  to  again  increase  until  the  end  of  t'la  normal 
operating  period  of  the  equipment  life,  point  D. 

The  flormal  operating  period  (A  to  B)  is  that  period 
In  terms  of  equipment  operating  time  in  which  the  average 
failure  rata  is  and  remains  essentially  eonutant.  Hera,  in 
measuring  reliability,  the  average  height  of  the  curve  ■ 

(A  to  C  or  B  to  n)  is  essentially  constant.  Also,. tha  use¬ 
ful  operating  life,  Ir  the  sense  of  longevity  p,rior  to  tha 
old-a  s  or  wear-out  period  can  be  identified  as  A-B  if  tha 
failui-  .rate  during  the  early  failure  period  is  intolerable, 
or  sons  iblng-  closer  to- 0-B  and  ceisured  from  tha  time  of 
equlpmerlt  delivery,  If  the  higher  early-failure  rata  is 
within  the  limit  of.  acceptability .  It  should  be  noted  that 
sometimes  the  onset  of  the  wear-out  period  (point  D)  la  a 
basic  function  of  total  equipment  age  (distance  0-B).  and 
sometimes  xt  is  a  .ba.slc  function  of  the  user's  environment 
and  maintenance  tcchnjq'-«  'and  thus  not  affected  by  an  interval 
(such  as  0-A)  which  elapses  prior  to  delivery  to  the  user. 

Re  - lability  evaluatlcjn  techniques  as  set  forth  herein  rely 
on  synthesised  rather  than  actual  user  environment,  and  ' 
equipment  repairs  are  perforce  'performed  by  personnel 
with  consideraoiy  different  skill  than  expected  in  the 
field.  Accordingly,  in  such  instances  where  the  onset  of 
e'-iuip-ment  wearout  Is  more  a  function  of  user  environment 
and  rr.ai.nteiianco  than  of  total  accumulated  equipment 
operating  time,  the  estimate  of  the  time  of  wearcut  made 
during  reliability  evaloatlon  may  differ  somewhat  from 
th«  time  of  the  wearout  later  observed  in  the  field. 


For  purposes  of  rolUbility  ovalMtioii  th*  con¬ 
vention  of  expressing  the  •‘•llAbllity  inUex  of  the  equip-- 
ment  (T)  in  tanas  of  tns  reciprocsl  of  failure  rate  (lA) 
or  nsan*time-between>f allures  (HTB/)  has  been  adopted; 

The  specified  acceptance  level  for.fallttre  rate  shown  in 
Figure  1  would  therefore  have  been  equal  the  reciprocal 
of  the  specified  MTBF.  Convention  also  dictates  that 
MTBF  be  taken  as  operate nx  hours.  Longevity  specified, 
however,  is  intended  to  Ve  calendar  time  including, 
therefore,  the  total  life  o?  the  equipment.  Longevity 
is  specified  as  indicated  in  Figure  1  and  may  be  ex¬ 
pressed  in  hours  or  years  or  other  tlsw  units  ss  ap¬ 
propriate  to  the  application. 

Thus  equipment  reliability  and  longevity  during 
pilot  production  and  i^oduction-may  be  defined  as 
follows: 

Tne  reliability  index  (f)  is  the 
constant  coefficient  in  the  formula 

P  »  e  expressing  the  probability 
of  performing  a  specified  function, 
under  specified  test  conditions,  as  a 
function  of  accumulated  operating  tin# 

(t),  and  is  measurable  and  expressible, 
as  hours  Bean-timo-betweeu-failures 
.(MTBF). 

Equipment  longevity  is  the  operating  -life  spaa 
during  which  at  all  tines  ths  specifisd  equlp-- 
ment  reliability  index  is  equaled  or  exceeded. 

It  is  worthy  of  note,  with  respeet  to  the  p»aslbillty  • 
or  likely  existence  of  an  early  failure  period  during  which 
the  reliability  index  ia  Inferior  .to  that  e:d>ibited  later, 
that  there  may  .be  some  temptation,  to  preeerlbe  a  atandard 
operating  period  (frequently  Identified  as  a  bum-in  or  debug¬ 
ging  period}  prior  to  relialility  evaluation.  However,  it 
must  be  kept  in  mind  that  thi  existence  of  sudt  an  early  fail¬ 
ure  period  is  a  function  of  m:. :ufacturlng  techniques,  parts 
control,  inspection,  and  quality  control,  rather  than  equipment, 
design,  and  is  thus  subject  to  change  with  production  evolution. 
It  would  seem  prejudicial  to  arbitrarily  expend  any  part  of 
the  u-oeful  equirir-ent  life  in  preference  to  improvement  ef 
production  techniques,  except  as  an  incertm  tseasare  to  provids 
time  for  study  preferred  remedy.  In  any  case  reasonable 
assurance  should  exist  that  all  delivered  equipments  meet  rs- 
liability  requirements  at  the  time  of  delivery  and  do  not  re¬ 
quire  any  burn>ln  the  user  in  order  to  demonstrate  acceptable 
reliability. 
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3.  ?.ir«luatioQ  Churaet eristics 

The  epeelf jed  tests  when  per/omed  on  the  prescribed 
production  samples  es‘‘.ab;ish  with  s  selected  confidence  that  s' 
statistically  tcrcwn  ni'..1or  fraction  of  the  entire  production  let 
of  equipments  possess  s  reliability  index  and  a  longetrlty  equal 
to  or  greater  than  those  mlnlaua  Talues  required  by  contract. 

In  addition,  and  as  a' result  of  performing  the  specified  tests,  ' 
it  will  bo  possible  to  sake  the  following  observations: 

(1}  While  test  results  from  the  test  of  pilot- 
production  equipment  will  in  general  only  be  representa¬ 
tive  cf  production  capability  for  achieving  reliability, 
the  eaae  teste  when  applied  to  controlled-proeess  pro¬ 
duction  will  yield  results  indleatlve  of  the  actual 
cUaraeteristics  of  the  produean  equipment, 

(2)  The  data  cclleeted  during  performanoe  of  test 
will  be  In  a  form  eultable  to  give  atrong  indication  of 
the  nature  of  romedy  to  obtain  reliability  Inproveaents. 

(3)  Conclusions  relativa  to  the  nean-time-bstween- 
fallure  as  determined  by  manufacturer* n  evaluation  will 
be  as  applicable  to  mean -tise-between-f allure  performance 
in  tactical  application  as  present  state-of-the-art,  da- 
sirable  standardisation,  and  practical  economy  permit, 

when  adjusted  foh  the  relative  field  maintenance  cepabllihy,  . 
and  it  will  be  reasonably  convenient  to  adjust  the  method 
of  selection  of  test  conditions  by  the  procuring  agency  to 

■  effect  closer  correspondence  with  the  field  as  rapidly  as 

■  field  experience  on  tested  equipment  is  acquired  and 

correlation  becomes  possible.  ■  ^  ’ 

ik)  from  viewpoint  of  program  economy,  both  with 
respect  to  the  number  of  tested  equipsetite  withheld  or 

•  delayed  from  delivery  schedule,  and  with  respect  to  dura¬ 
tion  of  test  beyend  desirable  schedules  before  conclusions 
can  be  reached,  the  confidence  level  asebciated  with  teat  . 
conclusions  may  purposely  be  reduced  below  an  otherwise 
desirable  level  in  order  to  suffice  with  loss  extensive 
and  protracted  tests.  This  carticularly  applies  with 

■  respect  to  tests  for  longevity.  However-,  it  must  be  boms 
in  Bind  that  lowered  confidence  in  primary  determinations 
does  not  invalidate  or  prevent  several  important  secondary 
yields  from  abridgsd  testing,  such  ss:  (t)  insight  to 
lugioblu  maintenance  requirements,  (b)  ad'*ed  data  for  cor¬ 
relation  with  field  experience,  and  (c)  '.nglneerlng . in¬ 
formation  of  great  benefit  to  future  design  changes,  new 
models,  and  lat*r  development. 
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B.  Approach  to  Achltvaaont  'f 

The  Comnittee  menbers  undertook  aa  their  first  oh* 
Jective  the  establishment  of  background  famlliarltatloa 
in  the  olectronlc  reliability  problem.  To  this  end,  a 
bibliography  of  reports  dealing  trtth  electronic  reliahilitT 
in  its  various  aspects  was  prepared;  This  was  augmented 
from  time  to  time  as  additional  titles  came  to  the  at* 
tentlon  of  the  Committee.  The  final  bibliography  is  included 
herewith.  The  reports  were  obtained  by  OASD  (AE)  and  dis* 
tributed  to  the  ComL.lttee  members  for  review.. 

A  total  of  15  meetings  wars  held  by  the  Committee  - 
oetween  17  February  and  .IB  December  19$6,  the  dates  of  the 
first  and  last  meetings.  During  the  course  of  these  meet*  > 
Ings,  various  aspects  of  the  problem  were  considered  and 
at  any  meeting  where  an  immediate  basis  for  formulating 
procedure  was  not  available,  members  Were  assigned  the 
task  of  organising  the  material  for  the  next  meeting* 

Several  visitors  qualified  in  various  phases  of  the  'probe 
lem  attended  the  meetings  from  time  to  tine  and  the  •* 
Chairman  obtained  consultations  on  certain  statistical 
aspects  from  others.  The  Chairman  also  made  a  field  trip 
'  to  the  Naval  Air  Devalopment  Center  at  Johnsville  to 
witness  and  disc-uss  reliability  teats  on  the  AN/AR1I*21,’ ! 
TACAK.  • 

It  has  been  the  expectation  of  the  Committee  by 
these  means  to  fulfill  the  objective  of  Its  missiou  by  pro* 
vidlng  specific  recommendations  in  as  readily  useable  fora 
es  possible.  Particularly,  it  is  Intended  that  these  be  of 
a  sort  which  are  suitable  for  defining  practical  procedures 
from  the  standpoint  of  technical  considerations  as  wall  so  -  ■ 
considerations  of  time  and  cost  in  their  employment. 


C .  Summary  of  Reaulta 

The  Committee  feele  that  it  has  fulfilled  the  eseeu* 
tial  elements  of  its  objective.  A  framework  of  methodology 
has  been  formulated  and  is  presented  in  Section  IZ.  of  this 
report.  Review  and  evaluation  of  statistical  test  tech* 
niques  have  led  tc  the  development  of  t.  unique  sequential 
8air.pling  method  for  the  reliability  teeting  of  pilot  pro¬ 
duction  and  production  models  in  order  that  the  evaluations 
will  .lot  necessitate  Intole.-able  production  delay  and  will 
permit  sound  decisions  at  adequately  low  risk.  .  The  ma* 
terlal  presented  in  Section  II  of  this  report  describea 
the  complete  test  method  and  procedure.  It  1«  In  a  form 
which  can  be  readily  adapted  for  use  'in  standards  or 
specifications.  Recommended  methods  for  data  collection,  . 
handling,  and  interpretation  ars  included  as  part  of  tht 
overall  procedure. 


It  1»  only  recently  that  reported  rellr.tlllty 
prograse  rave  begtm  to  look  for  correlation  betvcen  the 
results  obtained  free  tests  of  ths  nature  described  in  this 
report  and  the  frequency  of  equi^ent  failure  found  in  field 
use.  Although  favorable  correlation  ie  as  yet  neager,  this 
can  Bore  than  likely  be  attributed  to  the  usual  lack  of 
discipline  during  testa  and  to  the  siajor  differences  be» 
tvecn  the  cctiditiona  of  teats  and  the  eonditlms  of  field 
use.  Hoaever.  there  la  beginning  to  appear  encouraging 
evidence  uhieh  iudicatea  that  reasonably  good  correlation 
should  be  obtained  when  testing  is  controlled  to  the  extent  ■ 
rec.oamended  in  this  report.  There  is  unquestionable  ayi« 
dence  that  superior  equipment  performance  during  such. teste 
will' altmys  be  associated  with  markedly  iaproved  reliability 
in  the  field.  The  techniques  for  testing  as  rasommeuded 
herein  have  been  designed  to  pemit  certain  election  and  ' 
choice  by  procuring  agencies  such  that  Improvement  in  corre* ' 
latlon  will  be  rapid,-  autOBstie,  and  in  proportion  to  field 
experience  gained  on  previously  tested  equipment  categories.' 

Sectiou  II  of  this  report  is  intended  to  provide  the 
basic  aaterial  or  end>product  resulting  from  the  work  of 
this  Ta^  Croup.  Section  Ill -of  the  report  off  ere.  C  general 
diseusaioa  of  this  aa.te'rial.  Conclusione  and  recoaBenua- 
tiona  are  included  in  the  reffleicing  aeetlena.- 


n.  Xethods  for  Reliability  Tsating  of  Pilot 
Production  and  Production  E'quipoenta 


A.  Philcao^y  of  Test  Proeei*urca  and  Mathode 

lellability  evaluation  is  liateadad  to  augaant  all 
normally  required  performance  tests.  It  should  not  be  ' 
construed  that  the  environmental  requiramenta  associated 
with  the  reliability  evaluation  recommended  herein  in  any 
way  supplest  or  obviate  contract  raquirementa  for  -type 
testing,  khlle  it  is  not  necessary  to  establish  compliance 
with  type  test  r'equirementa  prior  tc  conducting  reliability 
tests,  there  should  be  .reasonable  assurance  that  the  equip-/ 
ment  is  capable  of  expected  performance  under  the  environ-  ‘ 
montal  eoadit'lons  chosen  for  the  reliability  evaluation 
before  it  is  begun.  The  performance  of  the  equipment  under 
the  .:vUditions  of  tbs  reliability  evaluation  must  be 
apecifiadi 

By  reference  to  figure  1  and  the  definitions  given 
in  the  introduction ,  It  is  readily  seen  that  the  two  basic 
characteristic  measures  of  equipment  reliability  in  pilot 
productica  and  production  are  KTB?  and  longevity.  It  is 
readily  apparent,  from  a  measuresent  or  test  viewpoint, 
that  the  footer  characteristic  is  the  more  Important.  Thia 
la  particularly  so  c^nce  continuation  of  the  equipment  re¬ 
liability  quality  te'^t  in  time  may  yield  all  data  necesaary 
for  the  ©valuation  of  equipment  rellabiilty  longevity.  Hanct, 
let  us  first  consider  ttie  pertlne.'t  aspects  of  equipment 
reliability  quality  testing. 
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1.  XalUMXlty  tv«itt«Uoa 

Th«  ICET  «!s»r*et*rlttle  for  tho  oqalPiWfc  («4  la 
fact  for  a  particular  lot  of  aqulpaaot)  la  ehoaaii  at  tb# 
aattauro  of  aqulpawec  r«liabilli7  index.  SlBC#  the  rella- 
bllltr  iBdex  of  aa  equlpiMat  in  tactical  operatioBi  eaa  ba 
eatabilebed  1b  terxa  cf  a  alagle  liaitiaf  value  of  Ita-MiCT, 
aueh  that  equitawnta  whose  characteristic  exceeda  this 
are  judged  satisfactory,  and  thosa  which  fall  short  of  this 
value  are  judged  lasatisfactory.  it  is  possible  to  desifa 
a  corrospoBding  testing  aethodoiogy  atatiatlcally  aoaaa 
and  requiring  ainlaua  test  data. - 

Accordingly,  the  statistical  design  of  the  sequential 
test  uethodolcgT  recoasended  herein  embraces  the  evaluation  - 
of  a  single  variable  against  a  single  (lower)  lialt.  Thir 
st<-tlsrical  evaluation  in  effact  tests  a  baste  aquipoent 
paranater;  vlt.,  K?B?.  This  parameter  in  its  yaletlonship  to 
the  lower  limit  is  the  measure  of  acceptability,  rather  than 
the  often  used  measure,  lot  fraction  defective.  In  the  reala- 
of  testing  eccncsy,  it  cay  be  noted  that  variables  testa  ra- 
quira  fewer  data  observations  than  attrlbutaa  taata.  '  Tha 
required  nueber  cf  observations  ia  further  reduced  by  the  -  . 
employment  of  a  sequential  teat  technique*.  The  nat  result  - 
of  thiu  test  selection- is  to  reduce  testing  tine  (or  OM-  .. 
versely  the  number  oi  equipments  for  teste)  to  about  3.0> 
of  that  normally  required  by  more  conventional  techniquea. 

The  two  kinds  cf  ecaventlonal  risks,  found  in  all  statistical  . 
testing  methods,  have  in  no  way  bean  comproalae.d  in  effcdB> 
ihg  the  aforemcntiecad  economy.  The  first  risk  le  that  of 
Judging  the  equlpcnst  unacceptable  when  in  reality  it -meats  • 
the  required  mlnimua,  and  this  rise  has  bssn- arbitrarily 
aet  at  1^.*  The  secs'ad.  risk  la  that  of  aecaptlng  squlpnant 
which  in  reality  dees  not  meet  the  mlnimua  requirement, .  Aad  , 
this  risk  has'been  a-bltrarlly  selected  to  permit  10)(  .  . 
probability  of  acceptance  of  equlpoent  whose  tftBf  ia  67n 
.  of  the  mlnimua  required.  The  mlnimua  MTBF  required  by 
centraet  has  oeea  chosen  so  that  67%  of  Ita. value  la 
aufflcient  for  tactical  requlreaenta.  Infoimation  la  con* 
tained  in  Section  III  to  permit  the  procedures  of  this 
section  to  be'*correoted  for  any  other  valuea  of-  rlak- judged  , 
more  suitable,  but  it  should  be- noted  that  lessening  of  . 
risk  Is  always  associated,  with’  Increase  of  teat  cost; 

Any  test  to -determine  the  KTBF  neeeeeitates  operation 
of  equipment  tested  for  sufficient  length  of  time  to  observe  - 
several  failures. *  lltnough  such  operating  requirements  may 
consume  no  more  than  a  negligible  portion  of  the  equip¬ 
ment’s  normal  useful  life,  it  -is  difficult  to  make  a  general 
statement  that  such  tests  can  regularly  be"  considered  non¬ 
destructive.  Acccriiagly ,- the  proposed  rellabllit/  testa 
have  been  deslgr.ed  tc  reduce  to  an  absolute  mlhimum  the 
cost  and  duration  of  the  test  program  ev*n  If  the  tests 
should  be  ctnsidersd  destructive  end  the  tested  equijjaenta 
unsuitable  for  consu.ter  use. 

Detertinetioa  of  MTBF  necessitates  the  observation  .of 
the  time  of  occurrence  of  a  number  of  failures,  which  can  be 
and  are  treated  as  a  sample  of  all  the  future  failures  expect¬ 
ed  tc  occur  d-jrinc  -useful  equipment  life.  Thus,  since  sampling 
techniques  are  inherently  required  for  determination'  of  the 
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reliability  oharaetertatlc,  it  ia  both  coBTceiant  and  e  l- 
aiatent  aa  wa^.!  aa  economical,  from  the  deatruet'ive  view  ‘ 
to  judge  the  production  product  by  teating  aamplea  rando»» 
ly  drawn  from  production  lota.  Although  the  validity  of 
general  eonclualona  baaed  on  data  from  a  aaaple  usually 
presume  and  rely  on  eharaeteriatica  behavior  explicitly 
in  accordance  with  a  known  type  cf  distribution  (vis,,  ex* 
ponentlal,  racdoa,  gaussian,  etc.)  the  statistical  method 
employed  herein  for  production  permits  certain  general 
conclusions  which  are  totally  independent  of  distributios> 
More  specific  ecnclusions,  available  tdica  the  production 
quantity  and  production  cycle  justifies  a  larger  sampling, 
do  bava  dependsncc  upon  the  assumption  that  ths  MTdP  of 
individual  aquipmsnts  in  a  production  lot  will  be  dis> 
tributed  (vary)  in  a  normal  manner  (following  a  Gaussian 
distribution).  The  most  significant  argument  in  favor  of 
this  conclusion  is  that  regardless  of  the  hetercgenelty 
(rather  than  homogeneity)  of  minor  details  in  a  production, 
lot  of  otherwise  identical  equipment  the  manufacturer,  in 
face  of  requirements  for  nlninum  acceptable  MT3F  obtainmont,  . 
will  do  everything  within  reason  that*  he*  can  to-^xlaisa-  - 
the  MTBF,  and  such  concentrated. effort  regularly  leads  to  a  - 
normal  distribution  of.  the  result. 

The  sampling  tests  for  production  equipment  herein 
proposed  are  based  on  a  continuous  easpling  plan  for  a  single 
attribute,  ths  KTBf  either  above' or  below  the  acceptable 
value  as  determined  by  the  sequential  tegt  technique  as 
prescribed  for  pilot-produetiou  equipments.  The  types  of 
risks  are  the  eane  (as  in  pilot-production  sequential' teste) 
and  their  numerical  values  are  ssleeted  to  permit  the 
magnitude  of  test  endeavor. to  be  consistent  with  .production 
quantity  and  scheduling. 

The  reilfbllity  index  evaluation  method  for  applica¬ 
tion  to  pilot  production,  sihce  it  involves  determination 
of-  capability  alone,  embraces  only  the  osthod  for  determina¬ 
tion  that  the  fiTBF  exceeds  the  expected  value  with  adeq'iattly 
llsited  rlskr.  The  test  procedure  for  produeticn  squii^ent 
involves  a  combined  test  wherein  the  tart  msthod  for  pilot, 
production  is  expanded  to  relate'  findings  from  the  production 
sample  to  the  entire  production  output. - 

?.  Equiprent  Longevity  Evaluation 

As  previously  indicated,  longevity  nay  be  measured 
using  the  identical  procedures,  environmental  ccnditloas  and 
methods  of  test  herein  applied  to  reliability  svaluatloa. 

The  -statistical  methods  of  selection,  the  quantities  tested  ' 
and  the  acceptance  or  re.jeccton  of  equlptsnt  by  scans  of  a 
sequential  test,  as  above,  are  similar  to  those  for  produc¬ 
tion  reliability  evaluation  except  that  the  confidence  level 
is  lowered  to  permit  the  frequency  of  this  protracted  test 
to  be  consistent  with  production  quantities  and  schedules. 


-This  chtrActcrittle  ef  le&gcvity  taatiAf  Mkt« 

th«  •st«blifiaM2t  ot  loai^tTitf  tcft  eristria  difflealt.  for 
oxaasla,  th*  t«n  parlod  roeuirra  to  aaasiura  tlao  to  ttXtlaot* 
vearsut  of  «  si&sl*  rolatlToIy  saalX  aad  uBCcaplaz  aqatpaoat  - 
{i;t«r>eoa)  aar  «xt«od  orar  aereral  ycara  whoa  toaticf  1« 
dcca  xusder  canal  •l:vlroBa«B^al  ccaditicsa.  Aloo>.  and  ia 
ccctraat,  a  larca  and  eoaplax  coan^tar  aay  oavar  raaeb  a 
r«cc£p:lx'abla  weiircnt  pariod  bacausa  of  bha  continval  aalsta* 
sazca  arograa  aasoclatad  irith  ano  prasaatiy  requlrad  by  tto 
cparatlcn  prior  bo  cbaolaecacea* 


5.  f iiot  Proaucttan  Teat 

rerhapa  the  cost  usual  reason  for  a  requiraaaat 
■far  rtio'i,  prod-iattoti  is  to  establish  ta  the  custoaer’s 
satisfaction  hi*  aaoeptance  of  a  s&nole  of  what  might  sa 
available  fr-oc  rseular  produaticn.  Ttzu  tha  saiiufaocurtr*#  - 
visvrcict,  pilot  rroduetion  perait*  his  to  prove  oat  toci» 
ir.?,  nanufacturing  processes,  evalua-oe  seeded  akillt,  and 
gar.erally  pin  davn  fLtal  details  Irralred  In  designing 
a  suitable  prcduatian  process.  Aaaardingly,  "it  la 
generally  assumed  tb-at  a  pilot  eroouctios  ran  .will  yield 
e:--ipcer.ts  anly  generally  ir._ocative  af  those  to  be  ax- 
teated  from  pronuation,  inaanucn  at  hishar  level  pertcsnel 
are  grr erally  employed  at  the  pilot  prcd-aotion  line  than 
will  Istar  be  assigned  to  nan  the  reg-lar  production 
line,  and  the  prooess  control  d-artng  pilot  production 
is  kept  in  a  very  flexible  ccnditior.  to  percit  process 
Asj-ustnent  tc  s&xinice  ecenrny  and  an;ust  for  perforpance 
reculrs-.anti.  I's-aally,  aany  changes  taka  place,  between 
the  beginning  and  the  end  of  pilot  rronuction  even  theugh 
b-at  fe-a  eouiprent «  are  produced  during  this  run.  All  ot 
these  factors  contribute  to  the  oonoluslon'  that  -any  tests  ’ 
cf  pilot  produced,  equipments  can  at  best  neasura  .eapabil* 
ity  only,  and  pilnt.  peiduced  aquircects  certainly- do  net 
belong  to  the  'sane  jw-palaticn  as  regular  production  equip* 
cents  processes  under  tight  prcduotion  ccntrol.  Kith 
capability  as  the  single  yield  from  ,'il:t  production  re*  . 
liability  testing  it  is  possible  to  grant  the  icanufacturar 
ccnplete"  freeaos  to  ohoesa  any  ao-atpmen*  s  ha  may  desire 
fr;n  the  pilot  pre-duction  ran  for  tne  reliability  test. 

If  he  cheeses  especially  reltabl'e  ecuipcents  ha  .risks 
generating  false* confidence  In  the  extent  of  rellaollity 
attalrorent  which  will  handicap  his  cl-anoss  for  satlsfas-* 
tar>-  reliability  in  production  ctuipcents,  as  well  as  tempt 
the  proc’j’^ng  agenties  to  raise  the" reliability  roquire- 
nent  '.  If  he  cht-ssss  especially,  unreltacle  equlpsants  ha 
riejts  finding  that  they  will  fail  tc  pass  the  loiiatility  - 
test.  In  order  tc  ncnici-e  the  cosatiility  that  the 
tllct-r’cn  eoul.tner.t  tested  is  not  typical,  the  m^nisran 
qua;;ti;y  cf  etuipoents  tested  should’ net  be  less  than  two 

The  methods  and  procedures  for  sanpllng,  aelacting 
standerd  envlrcratental  cor.diticr.s.  perfeming  the  relia¬ 
bility  test  recording  its  data, 'as  nail  as  for  data 
handling  ara  interpretation  are  set  forth  in  the  sub- 
seoticns  oalow. 

1.  Heliatility  Index  Evaluatlcn  Xetneds  and 
rrocedo'es 


1?  Sanple  Selection 
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PoBslbilltiti  ter  Mcpl*  ••Itetien  for  pilot  aodolo 
•ro  llBltod  b3r  tbo  usually  eaall  nuabar  of  aqulpsoats 
availabit.  fquipean.a  aay  bo  aalaeted  la  aay  aaquanea 
daslrad.  Each  anould  alraady  hava  daaenatratad  Ita  abil» 
ity  to  par fora  proparly. 

Tha  contraoci:;{  acaae'y  ahall  aaka  aa  alaeticn  as 
to  tha  nuabar'  of  aqui;e'asta  to  ba  asslgnad  to  rallabillty  - 
tast.  It  ia  to  ba  ectad  that  tha  prcbabla  laafth  of 
taat  vlll  vary  iavaraaly  with  tha  nusbar  of  OQuipaasta 
on  tast  (for  a  fixad  ccnfidanca  laral  In  tha  taat  outeoaa}. 
As  Halts,  tha  ciaiaus  nuabar  of  aquipaanta  aaalgnad  to  . 
taat  should  not  oa  lass  than- two.  and  tha  alnlaua  langth  ' 
of  teat  even  for  large  nuabars  of  aqulpsant  undar  tast 
should  not  ba  less  than  thraa  tiaas  tha  contract  spael- 
fxad  aaan-cioa>batwaao>falluraa.  Table  2  llluatratas 
possible  tasting  duration  rtraus  nuabar  of  aquipaanta 
assigned  to  taat: 


Table  2  -  .a.eiiablllty  Test  Tlae 


He.  of  •  ^ 

Dquiposents.  .  I,angth  of  Test 

for  Test  (in  aul*-lplas  of  MT8F) 


Short«.*t 

Lengdst 

• 

possible 

■Meat  Likely 

Possible  ' 

2 

3  (2.25) 

10.0 

■  16.5  ■ 

3 

3  (1.53) 

6.7 

11.0  . 

U 

3  (1.15) 

•  5.0 

M 

K 

3  (0.92)  . 

U.O 

6.6 

6 

3  (0.76) 

■  3.3 

5.5 

7 

3  (0.66) 

3(2.9) 

.  4.7 

8 

.3  tC.57) 

3  (2.5) 

4.1 

9 

.3  (0,51} 

3  (2.21 

3.7 

?0 

3  iO.ui) 

3  (2.0)  ' 

3.3  . 

Length  of  test  is  shown  for  accepts  sis  equipment.  Unaecept- 
abie  equipment  will  fall  the  test  in  an  squal  or  shorter 
period  of  time  than  that  sr.ovm.  The  values  shown  are  xultl- 
?ies  of  the  specified  XTSi'  i?).  Kiusbsrs  in  parentheses  are 
the  times  expected  were  it  not  for  the  arbitrary  'requirement 
that  r/ne  length  of  tests  be  not  less  than  three  times  the. 
contract's  specified  mean-time-between-fai.lure.  The  co.n- 
venticn  of  extending  tne  tests  to  at  least  t.hree  times  the 
specified  KT??  is  aoert ed  to  (a)  provide  additional  data  in 
case  of  a  dispute  and  ,t.-  provide  information  for  corrective 
action  In  case  tne  equireef.t  is  rejected. 
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(b)  fiavlranamtil  SpeeificAtion  aad  T«*t  Cdnditiens 

7bc  following  section  specifies  stsndsrtfitei  test  sen* 
dltions  for  the  rellsblllty  test  whldi  will  psmlt  relia¬ 
bility  oosperiscn  between  the  many  prceurcnent  prograu 
without  significaat  compromise  to  field  eerrclation.  The 
figure  of  merit  or  reliability  index  (ffleia-tiae-betweea- ■ 
failures) -obtsined  for  the  equipoent  under  test  will  be 
a  useful  nes sore  of  the  field  reliability  even  though  thf 
test  conditions  only  approxicuitely  aiisuiate  the  coebised 
envirensental  effects  which  may  be  obtained  in  field  use. 
Thus,  while  the  measured  KTBF  may  differ  somewhat  frcr 
that  prerailicg  during  operational  usa,  this  discrepancy 
will  be  small  in  contrast  to  that  dus  to  errors  of. 
measuring  teehrique,  differences  in  application,  fiald- 
maintenance,  etc.,  ar,d  is  a  small  -price  to  pay  for  tbs 
many  bdnefits  of  standardisation,  especially  the  op¬ 
portunity  to  compare  unlike  equipments  under  staneardlxed 
conditions. 

A  series  of  especially  chosen  environmental  test  con¬ 
ditions  in  fcur  levels  of  stress ' severity  arc  presented. 

The  four  levels  chosen  art  a  practical  comprcslae  t« 

•coyer  a  wide  range  of  scr.ual  onvironaental  condltleaf. 

Field  correlation  with  test  results  as  well  as  a  general 
incrcasu  in  the  state-of-the-art  may  Justify  more  stringent 
tests  wh.ch  can  Chen  be  devised.  The  four  conditions  given 
are  believed  adeouate  for  use  on  pilot-production  and  pro-, 
duction  eauipcer.ts  in  proving  the  Approximate  inherent 
reliability  cf  mast  present-day  and  near  fbtiire  electronic 
equipments.  '  . 

The  appro criate  levci  for  use  on  any  speetfie  project  . 
is  to  be  selected  by.  the  contracting  agency*  The  level 
which  most  closely  duplicates  the  extreme  conditions  of. 
end  use  Is  prefera'ble.  The  level  thus  selected  will  then  - 
apply  to  all  subsequent  production  of.  the  came  item  eo  - 
that  uniform  reliability  coeparieon  ia  poaaible.  In  the 
interest  cf  standardisation  of  tests  and  correlation  of 
results  no  deviations  fres.  the  prescribed  testp  should  - 
be  considered.  It  is  assumed,  however,  that  all  use 
parameters  critical  for  specific  equipeents,  such  as  cool¬ 
ing  air  flow-  and  extreme  humidity  will  be  specified  for 
test' sinulition  in  addition  to  the  specifications  bereln. 

It  is  emphasized  that  these  tests  are  intended  to  be  . 
appllec  in  addition  to  all  normal  type-approval  and  ac¬ 
ceptance  tests.  •  *  - 


of  S-nvlroRmental  Tests 


The  eiivircrjsental  conditions  cnosen  are  rsstrietad 
•to  Tlbratlen,  teaperature,  on-off  cycling,  and  input 
voltage  for -reasons  of  practicality  and  correlation  of 
results  through  simple  standardization.  Tests  Involving 
other  envlrcnmenial  conaitions  a-ach  as  altitude,  humidity, 
and  shoe*:  are  omitted.  It  1»  felt  that  the  standard  type- 
te.ns  will  reveal  basic  faults  in  these  areas  and  that 
little  is  to  be  gained  by  Including  them  here. 


Tbt  rMsoning  b*hiJ>4  .th«  Mlaetloft  of  ««eh  of  tbo 
•nvlroiunntal  teoto  to  a*  followc  and  ahoutd  ba  usod  aa 
a  nlda  la  aatabllahlna  taata  for  futura  aquiptanta  aa 
well  aa  aatabllahtog  additional  taata  which  ru.j  b*  ap* 
propriatai 

Tannaratura 

The  taaparatura  la  intandad  to  approxiMta.  the  aar> 
vice  coniitiona  under  which  the  a^uipaant  will  bo  raquirad 
to  operate. 

fibratioa 

Thia  ia  not  intended  to  be  the  aoat  aevara  condition 
encountered,  but  ia  felt  adequate  to  ahow  up  worteanahip 
Itena  euch  aa  looae  aolder  Joiata,  Iqoaa  parte  aueh  aa 
aerewa,  blta  of  wire,  etc.  Thia  teat  la  to  be  perfonad 
with  the  aquipaent  aountad  aolidlp  on  the  vibration  table 
without  abock  eounta. 

Off-On  Cvcllna 

Thia  test  la  priaarilp  to  give  the  aquipaent  a 
teeperature  cpcla,  cauaing  the  entire  aquipaent.  to 
''breathe*,  expand  and  contrart,  ba  axpoaed  to  the 
eurgca  of  ctarting  electrical  power,  plua  checking 
actual  oparatlCin. 

Input  Toltaae  . 

Tarring  the  Input  voltage  both  above  end  below  the 
norwal  rated  voltege  place#  atrain  on  the  verioua  ^reuita 
and,  aittce  this  ia  a  noranl  condition  ia  aorvlce,  will 
ravoal  aeny  weak  condltiona. 

Teat-Levala  . 

The  four  levels  of  atreea  severity  ere  L,  P,  1, 
and  Z,  for  Light,  Kedlua,  Sigh,  end  Extreae,  re-  ■ 

spectlvely.  Since  thez«  la  nlvaya  a  pcealhlllty  that  any 
prolonged  atrcaa  can  cause  part  depreciation.  It  le  recoa- 
cended  the  *  vai0  lowest  adequate  level  of  test  be  used. 

The  adequacy  of  r.  test  can  be  established  by  correlation  .  • 
between  test  results  end  field  results,  O'he  adequacy  of  an 
equlpsent  to  ?ieet  specified  tost  levels  will,  be  revealed  In 
the  failure  rete  oblal/^ed  during  the  test  interval. 

The  factors  of  length  cf  test,  quantity  cf  equlpwenta 
tested,  and  failure  enalysls  techniques  are  discussed  elsa- 
vbere. 

Tort 

Tropurature  «  2?®  £  5"^  {68or  -  Key) 

Vibration  *  None 

On-Off  Cycling  s  TJuree  heura  "onf  plus  long  enough 
to  srabiUze  at  both  high  and  low 
teKrerarure  by  actual  ocasuree^nt 
Sse  telov. 

Input  Voltage  *  N’oKlnal  •'o  long  aa  within  tquip- 
r-".l  specifiei  voltage  range. 


Th«  T««t  t  !•  lataaddd  to'  bt  •  olBpl*  bonoh  tost' 
ttndsr  Bomsl  foetorf  conditions  for  «m  ifltb  oqnipMirts  vlitoli 
will  oporrto  undor  siailsr  aild  ecnditiens.  A  tfsieol  s^^ 
•ont  for  which  tost  l>  tight  bo  osod  is  «  ground  boood  rodio* 
rolsy  sot*  A  sot  whidi  «ust  bd  usod  in  the  tropics  or  in  • 
poorly  ventilated  area  say  require  the  use  of  Moro  savors 
tests.  The  application  will  indicate  the  apivopriato  tost* 

The  *off*  cycling  tlaa  nay  be  wore  or  less  than  one 
hour  depending  on  the  site  and  eonplexity  of  the  equip* 
went.  The  criteria  is  to  datemine  by  actual  neasareaent 
that  the  hottest  internal  area  cools* down  to  ai^roxinately 
rooM  temperature  during  -  %e  *off*  cycle.  The  rate  of  cool 
down  can  bo  used  as  an  indicator.  Ae  the  '  -ft  opot  tempera¬ 
ture  approaches  its  local  ambient  the  cooling  rate  will 
level  off.  At  this  point  the  "on*  cycle  can  begin. 

The  "on*  cycling  time  may  ba  mora  or  less  than  3  hoots 
depending  on  the  conditions  and  type  of  aguipment;  For 
acample.  acme  equipment  may  have  several  states  of  *oa*  ' 
such  aa  transmit  and  reeaiva.  etc.  The  duty  cycle  of  Cht-  , 
transient  operating  conditions  for  the  *on*  period  auat  ~ 

'oe  established  by  the  contracting  agency.  This  is  alndl^r-.  - 
ly  true  for  all  -the  levels  of  teat  to  be  described  in  the 
following  paragraph.  . " 


Test  M  (Kediual 

Teapcrcture  » 
Vibration  • 
On-Off  Cycling  • 
Input  Voltage  ■ 


4C®  £  5*C  (95®r  to  U3®F)  . 

2$  »  $  cps  at  *  1/32*!  MX.  AwpIitmdOi 
Sams  as  Tost  t.  ' 

Kaximua  specified  permiaslhlo 
Voltage  SO 


This  medium  test  M  is  similar  tb  test  L,  but  requires  •  .. 
mild  vibration  test  and  h  heat  room  Which  can  baii^wvatod  ia 
temperature  and  maintained  at  AO**  ♦  This* wiXs'sImlato 

conditions  for  mobile  and  shipbome  equipment..  Equipmemt 
with  marginal  cooling  provision  will  develop  serious  hot 
spots  in  this  tesfto  reveal  inadaqaata 'design.  The  ■on*. 
ti<r«  should  be  three  hours  plus  time  to  stabilise  the  Imtamal 
average  tesporature  to  the  ertemal  ambient.  The  euff*  time 
should  be  adequate  to  cool  the  intsrior  to  external 'smblant. 

The  vibration  provision  can  ba  met  by  mounting  the 
equipment  solidly  to  a  strong  flat  plats  idtlch  is  support¬ 
ed  by  vibration  mounts  and  to  which  a  aynchrosous  motor 
with  an  asymmetric  'weight  is  attached.  Adjusting  the 
asjncxetry  of  the  weight  can  control  the  naxlB<j«  aaplituda 
of  vibration  to  *1732  of  an  Inch.  The  direction  of  vl- 
bracion  is  not  critical.  •  The  purpose  of  this' shake  test 
is  to  dislodge  faulty  connertlons  such  ,as  no-soldsr 
Joints,  and  to  reveal  other  workmanship  defects  in  tubes 
and  eculpeent.  Tests,  conducted  on  equipmait  under 
vibration,  can  detect  rai functions  not  apparent  wT.en  tha 
equlpcient  lo  operated  under  static  conditions.  Examples 
of  discrepancies  fchich  can  be  located  In  this  manner  are: 
microphonics,  Interrlttsnts,  and  insteoilltles.  It  may 
also  reveal  tabes  w.oich  are  sensitive  to  alca  wear.  Tha 
durat*vin  of  vibration  should  be  at  least  10  mintites  out 
of  'Very  hour  of  time  and  continuous  vibration  ia 
pe*  ttlsalble. 


lys 


\ 


Chaflb«r  Ttmparatura  **54^0  to  *5;®C  (-65®f  to  130®F) 
Vibration  •  Sant  aa  Tast  K 

On-Off  Cycling  -  .  *  »  *1 

Input  Voltua  •  Kaxiaua  Spocifiod  p'raiaatblo 

.  Vo/.taga  i^0-2i 

Thia  High  tast  H  ia  intended  for  usa  t^ith  auch  equip¬ 
ments  aa  must  operate  Klthln  thia  tamparature  range.  It 
requires  the  use  of  an  envircnmental  teat  chamber  which  can 
change  rapidly  from  -54^0  to  «5$°C  or  two  chambers  and  a 
means  for  rapidly  moving  the  equipment  in  a  water-tight' 
plastic  bag  or  dry  air  loc'ic.  The  teat  aequence  ia  snowa 
in  Vlgure  2.  If  the  equipment  ia  henaViisally  aealed  or  ia 
IntendQd  to  operate  when  dripping  vet.  no  precautions  need 
be  taken  during  the  charibsr  transfer.  There  Is  no  intention' 
here  to  penellze  the  equipment  with  high  humidity  or  cen- 
denaatlon.  This  test  combines  severe  thermal  shock  with 
vibration  and  vlth  starting  from  a  very  cola  condition* 

(The  equipment  ia  turned  on  in  cold  condition  before  vam- 
Ing  up.) 

Test  I  (Extreme)  .  . 

Temperature*  '•  -65®C  to  r71®C‘(»85®F  to  l60*f) 
Vibration  •  The  same  at  Tast  M 
On-Off  Cycling  s  •  •  e  w  L 

Input  Voltage  •  *  «  .  v  •  •  M 

The  Extreme  Test-X  la  the  sane -as  7aet  M,  but  ia  in¬ 
tended  for  use  with  equipment  which  will  be  subjected  to 
a  more  extreme  temperature  range.  It  ia  Important  in  both 
Teats  H  and  X  that  the  equipment  be  turned  "on**  ea  eoon 
as  it  is  placed  cold  In  the  hot  chember  or  as  soon  as  thb 
heat  is  turned  on.  The  length  of  time  required  to  stabilise  ' 
the  equipment  at  both  extremes  can  ba  measured  ore*  f.*r  a 
given  equipment  and  thereafter  nutomatlcally  timed; 

c.  Test  Procedure  ,  • 

This  is  a  testing  procedure  based  on  sequential  > 
analysis  to  determine  if,  under  specified  test  conditions, 
a  given  sample  of  equipments  exhibits  a  racan-T'jie-between- 
failuroa  vrilch  is  equal  to  or  greater  than  a  specified 
minimum  value. 

(1)  The  sample  of  equipments  for  reliability  test 
Kfiy  bo  selected  in  any  manner  at  the  contractor's  disrrstion. 

|2)  The  selected  equipments  shall  be  fitted  with 
elapsed  operating  tine  meters  vdjich  will  indicate  the  total 
hours  of  test  time  accumulated  by  the  equipment  to  which 
attached. 

(3)  A  log  shall  be  set  up  for  use  during  the  test 
which  has  coiomns  assigned  to  the  lollowingt 


jhoeTirei 's  of  tenmerature  vlll  be  goverreJ  by  the  latest 
ay  plicablf  'jpeeJf  lent  lens. 


j  iru  irti  s 


t  irv  ^  V 


-  '•■dC-SaKMMul 
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0. 


Lin*  nuab«r 

Cons«eucive  nuabar  of  failures  obstrved 
Dat*  and  time  of  failure  obsenration' 
AectUBulated  operating  time  on  equipment  01 


at  time  failui**  in  coliuon 
Same  as  (d)  for  equipment 


was  observed 


n  m 

m  M 

tt 


« 

n 

n 

n 

n 

m 


n  « 
e  e 
m  m 
*  n 


units  under  t* 


Total  of  columns  (d)  through  (m) 

Column  (n)  divided  bjr  contract  specified  aean-tia*> 
between -failures^  See  Table  3,  Note  1. 

(4}  The  tost  shall  begin  onlf  after  both  the  equip- 
Ecnta  to  be  tested  and  the  test  'Instrumentation  facilities 
have  had  suitable  operational  check-out. 


(5)  Under  no  condition  is  the  test  to  be  terminated 
because  of  decision  to  accept  or  reject  the  equipment  in  ac¬ 
cordance  with  subeeq'uent  criteria  until  each,  equipment  under 
tejt  has  accumulated  an  .operating  time  equal  to  or  greater 
than  three  times  the  specified  mean-time- betwe.en-f allures.  . 
Svidenc.e  s'cbsequent  to  the  first  decision  event  may  reveal 
the  necessity  for  and  direction  of.  investigation  to  reconcile 
any  apparent  conflicts. 

(6)  At  the  Instance  of  each  failure  a  log  entry  is 
to  be  made  «n  a  single  line  with  ooserved  data  for  each  of 
the  columns  listed  in  paragraph 

(7)  Log  data  from  columns  (b)  and  (o)  (paragraph 
(35)  at  the  completion  of  each  set  of  entries  following  an  ob¬ 
served  failure  are  to  be  compared  with  Table  3  to  determine 

if  a  decision  is  posslbls  as  to  whether  the  'sample  has  passed 
or  failed  tne.test  requirement.  Vihen-a  decision  is  indicated 
by  Table  3  the  test  is  to  be  discontinued  provided  the  re¬ 
quirement  of  paragraph  5  is  met.  Otherwise  the  test  shall 
continue  (with  log  entries  as  appropriate)  until  the  requlre- 
Eer.t  of  paragraph  5  is  met,  wnereupon  the  test  is  to  be  die- 
ccctinusd.  Log  data  accumulated  during  such  test  extension 
interval  are  to  be  used  for  info.'mation  only  anl  are  not  to 
bs  used  as  a  basis  for  altering  a  decision  from  Table  J 
possible  at  an  earlier  time. 

(8)  On  ths  occasion  of  a  failure,  the  failed  equip- 
sent  is  to  be  removed  and  repaired  without  Intenniptlon  of  the 
test  of  .equipment 8  continuing  to  test  performance  re- 
q'liremsnts.  Upon  decision  that  a  failed  and  repaired  equip¬ 
ment  has  been  returned  to  representative  operative  condition 
it  shall  be  returned  to  test  without  interruption  to  the 
equl;  •'ents  continuing  the  test. 


(9)  The  absence  of  one  or  more  equipments  for  the 
purpose  of  failure  repair  shall  r.ot  affect  the  ability  to 
itaie  decisions  from  log  data  and  Table  3», 


IABIJLI 


RKLIABILITT  TEST  CRITERIA 


Tla* 

Failures  . 

•  . 

Normtllz«d  Reject  Decision 
Test  Tiae 

Accept  Decision 

Continue  Test 

If  beltw  noted 

If  no  more  than 

If  nunber  of’ 

failure  occurs 

number  of  fail- 

failures  fall  Ic 

on  or  before 

ures  below  occur 

rangs  below  at 

■  correspoc'iing 

by  the  time 

tias  shown,  con- 

tine,  Equip- 

shown,  Equipment 

tinus  tost. 

nent  failc. 

passes,. 

See  Rote  1  See  Note  2 

See  Note  2 
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TABLE  3  tCon’t 


I 


Nott  .**;  Und«r  no  condition*  is  ths  Ilfs  tsst  to  bs  diseontiousd 
becaus's  of  i  decision  to  fail  or  pass  the  teat  per  eoluan*  2  and 
3  of  table  until  each  equipment  has  accumulated  an  operating  ties 
at  least  equal  to  three  tines  the  contract  specified  veanotiaiso 
betu'een-failures. 

Note  3;  The  circled Q  points  in  the  chart  represent  the  average 
duration  of  test  before  decision,  for  equipcent  that  is  Just  outsld 
the  narginal  region.  The  marginal  region  is  considered  from  0.6? 
to  1.0  times  the  contract  specified  a£an-tlBte-between'*failures. 

Note  k"  The  m  superscripts  denot*  the  average  duration  of  teat' 
before  decision  for  equipment  whose  actual  iieaa>tiBe-betweeno  ' 
failures  is  approxiaateljr  midway  In  the  marginal  region  (0,03 
timsa  contract  specified 'Baan->tlae-between>xailttrss], 


■  i36 


ruirr-Tw  r*- 


r  *  IT  .  irv  W2A  n--  w  ^  t- 


(10)  Vh«a  u-aoMpt  ^aeialoa  !•  aad*  baeaaM  of  ■ 
aesuaulttad  opareting  tlM,  «£  «£.tr]r  i»  to  o*  ud#  «■  « 
aaparAw*  Hot  In  tha  log  of  foilurta,  vltb  notation  in  eolnan  ■ 
(b)  indicating  that  an  aeeapt  itslalon  rathar  than  a  fallnrc 
oecurracca  has  occasioned  tba  log  aatry. 

d.  Cata  Handling 

Tho  raeonoandad  rulac  and  croeadiu'sa  for.  data 
handling,  tc  ba  sat  forth  in  this  section,  hava  bean  as- 
tabllshed  subjact  to  cartain  basic  praeisaa  which  govam  ■ 
the  oathods  for  reliability  testing  covered  In  f'is  re¬ 
port.  To  better  appreciate  data  handling  rulaa  and  • 
procadxires  the  pertinent  basic  premises  follow: 

(1)  Vhe  eqtjipcent.'t&  be  tested  shall  be  of 
the  type  which,  having  failed  can  be  repaired  and  returned 
to  satisfactory  operating  conditlca  without  replacesent  • 
of  the  entire  oqulpcent*  Thus  an  aauipaer.i  eomprieing 
two  unrepairable  heroetic  najer  units,  tegstbar  with  the 
seans  for  necasea^  Interconnection  will  qualify,  einee 
in  the  typical  cese  it  can  be  presusad  that  an  equipbant 
.failure  can  ba  remedied  by  replaca:.ent  ef  one  or  the  , 
other  (not  bath}  of  the  .two  iia.;or  in:it8.  The  test  of 
"unrepairable*  (only  replaceable'  equipoent  necessitates 
uoaa  alteration  of  the  relisblli-qr  eest  for  the  eonr 
fidence  stated. 


(2) ’  The  recomaended  sequential  test  neesures 
the  MTBF  with  respect  to  the  acceptable  sini*u«  of  the 
sample  (of  equipments)  selected  f-cr  test  with  90%  con¬ 
fidence.  In  the  absence  of  ruaufacturing  control 
prqscd'urcs  tc  guarantee  lot  hosogenelty,’  it  can  there¬ 
fore  only  determine  capability  of  tr.§  ssoufacturing  process 
(rattier  than  product  acceptability}.  Bec-aoe  of  the  i»- 
pcsalbillty  of  substantial  ys-tcess  ocatrol  during  pilot 
production  the  test  can  be  cssumec  tc  be  a  neaeure  ol 
r*l-labUitr  capability  only.  Vr.en  arclled  to  regular  pro¬ 
duction  under  close  process  ccr.trcl  rather  then  pilot  pro- 
d’l-T.lon, . a  rsnd.rs  sampling  process  can  yield  a  measure  of 
the  reliability  from  a  production  lot. 

(3)  The  recommended  test  does  not  directly 
lead  to  a  nunerical  tneasure  of  reliability  but  ratbe- 
establishes  with  9031  confidence  tmat  the  tested  uniw.>-- 
equai  or  exceei  the  olnlisur.  speciflci  r.ujserlcal  MTBF- 

5y  socondar:.-  calculation,  the  data  avsilabla  fnom  the 
tests  r.ay  be  used  to  yield  a  reasor.acle  estisate  of  the 
actuf.l  numerical  KTdF. 

{4}  The  recocRested  test  does  not  evaluate 
the  sa.mitude  cr  tho  dui-ation  of  any  aarly  failure  period 
in  the  sample  being  tasted,  nor  cces  it  establish  the 
onset  of  wear-cut.  It  is  pres-usi  that  the  equipment 
a.\r,ufftct.urer  vi'.l  take  a-ctive  nesR.r'rS  to  perform  any 
ui’-uf,?: ”5  ro'.'j “v  p»”lcr  to  t.~,e  test  in  order  to  gain 
assurance  of  ;.a3sing*the  test.  S.-.c-ia  the  tested  sample 
cass  the  test  even  thourn  nesiracie  zeourrir.g  had  not  teen 
'■erforsei,  it  ray  fc.e  categorically  ccr. eluded  .that  the 
e.;.iicc:6nt  has  .higner  rellacility  tnan  the  .minlnu.m  required. 
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it  test  do*a  not. 'nor  la 

***«!**  r*^*  plae«  of  «  eompr«hensiv«  ptrfora* 

‘he  ae?uentl.l  teet  .re  selected  a.  * 
sample  of  such  critical  and  comprehensive  per- 
fo^nce  parameters  such  as  are  most  likely  to  indi.'ne 
every  instance  of  equipment  failure. 

a...  ».  ^he  recommended  test  and  the  asscclated 

•  primary  responsl- 

^®r.  causes  and  remedies  for  unreliability 

However,  the  data  are  handled  in  such  a  way  as  to  aiva  the* 

information  with  respect  to  remedial  • 
action  in  the  caae  of  failing  to  pass  the  teH. 

Data  are  handled  and  recorded  with  auf- 
‘®  P®">>i‘  at  laaat  one  cross  ' 

inrermr^io^aa?'^*  ®**‘^**‘  id-ontify  any  record-  ■ 

ing  errors  In  data  entries,  thus  peraittiiut  an  iwBrovsd 
basis  for  the  arbitration  of  resulting  data  dlspu^.  . 

...Ic  ..  Since  the  teat  method  outllneii  hedn  ‘ 

‘’eff?”  Pliability  acceptance  in  terme“rthe^5i)- 
la  dao-nrf*^  pattern,  and  since  the  true  count  of  falluros 
la  ce^ndeM  upon  adherence  W  the  repair  activltv  ta 
certain  rules  to  be  set  forth:  It  ir«senClal  thL  2ii 

““lias  ‘he  tMt  be  perforaJd  bj  Ss 
lea^t  pre,,udlced  and  best  qualified  repair  oeraannai ■  ana 
tMt-  such  work  be  performed  under  the  survaillance  of 
the  Inspector  in  charge  or  his  deleSt^!”  ^  ® 

basis  of  handling  ars  aads  on  the 

premises  recording  essential  to  the  above 

ficient  end  rapid  reliability  test, 

that  t*8f.  ahould  be  af  least  ' 

cnac  necessary  to  complete  four  kinds  of  oaf*  ■ 

lour  data  forms  are  identified  a.  fSllowt  ’ 

1.  log  of  Failures 

2.  Operation  Sheet 
3-  Palluptf  Report 

1.  Equipment  Repair  Sheet  . 

log  of  Failures 

all  of  intended  to  contain 

whether  the  ,  -  ®  decision  as  to  • 

is  inten'erf  » w  f  •  passes  or  fails  the  test.  It 

wfi t  a  f/eprinted  form,  as  described  below  («• 

Siiiiipsr' . 
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th*  headitifr  of  the  Lo^  ox  failure*  form  ahould 
contain  customary  identification,  including  eomplcta  ref¬ 
erence  to  the  test  and  teat  conditions,  test  facilities, 
tested  equipment  including  equipment  serial  cumbers,  data 
of.  beginning  and  end  of  test,  name  or  identification  of 
data. recorder,  and  page  number  where  more  than  one  sheet 
is  needed  for  the  test..  Much  of  this  information  can  be. 
governed  by  reference  to  applicable  secondary  dbeumenta- . 
tlon  if  assurance  exists  that  such  secondary  doc<xaantatios 
has  been  prepared  prior  to  initiation  of  the  test..  . 

following  the  heading,  the- Log  of  Failures  ferm 
should  be  ruled  into  the  necessary  number  of  columns, 

15  columns  being  required  for  the  simultaneous  tests  of 
ten  equipments.  The  number  of  required  columns  varies 
linearly  for  intermediate  numbers  of  equipeenta.  The 
columns  .snould  contain  abbreviated  headings  in  accordanca 
with  the  following  list: 


a. 

b. 

c. 

d. 

e. 

*  a 

h. 

if 

J- 

ks 

1. 

n« 

Os 


Line  niunbtf'r 

Consecutive  number  of  failures  observed 
Date  and  time  of  failure  observation 
Accumulated  operating  time  on  equipment*#! 
at  time  failure  in  column  (b)  was  observed 
Same  as  (d)  for  equipment  #2 


ft 

It 

ft 


ft 

ft 
ft 

ft  ft 
ft  ft 
ft  ft.- 
ft  *  ft 
ft  ft 


ft 

ft 

ft 

ft 

ft 

ft^ 

ft* 

ft 


#3  if  3 
h  if  4 
.ft  5 


I 


samples  test* 

e  •*  ft 


no 


"  6 
•  7 

"  a 

-  V 
» 10 
(*) 


m 

a 

n 

m 

m 


« 

* 

-I 


Total  of  columns  (d)  through 
Column  (n)  divided  by  contract  specified  nean-tiaa- 
between-fsilurea. 


Under  the  column  headings  the  fora  should  be  ruled 
A- 1th  a  number  of  equally  spaced  horizontal  lines,  with 
.-•ufflcient  spacing  to  permit  ••orh  line  to  be  used  for* 
separate  equipment  failure.  .The  data  recorded  are  not  of 
»^he  nature,  to  require  any  totals  at  the  bottom  of  any 
columne.  Data  recording  shall  comply  with  the  requirai. 
ments  set  forth  in  the  previous  section  "Test  Proced'ire". 


Operation  Sheet 

The  Operation  Saeet  is  designed  to  permit  data  ' 
recording  of  such  a  nature  as  to  fora  a  log  of  the  signifi¬ 
cant  activity  of  the  test  operators.  It  provides  means 
to  cross  check  for  the  existence  of  any  failure  inadvertently 
o.Tiitted  from  the  Log  of  failures,  further,  it  permits  means 
for  arbitrating  any  contention  that  observed  equipment  fail¬ 
ure  was  In  truth  the- fault  of  the  test  facility  rather  than 
the  tested  equip.rent.  It  establishes  the  presence  on  the 
desired  routine  basis  of  operating  personnel  throughout 
the  duration  cf  test. 

The  heading  of  the  Operation  Sheet  should  contain 
z.c'ir.s  for  irieritlflcatjon' of  tne  test,  identifl^atlcn  of 
the  equipments  under  test,  date  applicable  to  data  (.below). 


and  paga  ntinbar.  Raferanc*  to  raeondary  doeumantatlon  1 
to  shorten  heading  antry  1*  pemiesible  oi*  the  •aae-haai*  fl 
as  described  for  the  Log  of  Peiluree.  i 

Under  the  heeding  the  Operations  Sheet  should  be  | 
divided  into  coluons  in  accordance  vith  the  follouin^  .1 

a.  Line  uuaber.  '  I 

b.  The  2nd  column  should  be  for  local .time 
of  the  data  entry  . 

c.  One  or  mors  columns,  as  deeaed  necessary, 
should  be  provided  for  repeated  cdnitoring 
of  critical  enviroftaental  pa.*aaeter8  and 
}\iwer  supply  parameters.  ' 

d.  A  group  of  columns  should-  be  provided  for  - 
each  e<]ulpaent  performance  parameter  mohi-' 
tored  on  a  repeated  basia  during  the  teat. 

e.  Each  coltmoi  group,  as  described  in  (d)  above' 
should  contain  as  many  columns  as  .there  are 
e'tuipffler.ts  assigned  to  sitniltaneous  test 

-(from  2  to  10).  The  vidth  of  each  column  should- 
be  sufflolent  to  pertalt  the  «ntry-  of  a  numerteal' . 
value  for  the  performance  parameter  monitored, 
or  a  cheek  toark  If  more  applicable.  Ths  nueerleal. 

-  parameter  is  prsforsbie  to  the  cheek  aar'><  be« 
cause  of  Its  greater  guarantee  of  operator  ftt> 
tention.  The  last  column  should  be  for  the 
name  or  Initials  of  the  data  raeord*r  making  the 
data  entry. 

Beneath  the  column  heading.  The  Operations  Sbset 
should  be  ruled  with  horizontal  lines  to  permit  one  line 
to  be  used  for  each  observation  of  the  sample  under  test. 

It  is  presumed  that  equipment  operating  in  the  absence  of  - 
failure  will  be  routinely  cbecced  on  coma  periodic  bsslr 
such  as  once  each  hour,  or  once  each  15  ninut  as,  etc.  It 
has  been  found  that  periodic  data  entry  permits  far  more  ' 
accuracy  than  other  techniques  such  as  ^contlnuoue  scrutiny 
with  data  entry  only  upon  occasion  of  Irregularltv. ■ 

Should  attention  be  drawn  to  equipment  failure  between  in* 
tervals  of  regular  data  taking,  the  next  available  line 
on  the  Operations  Sheet  should  be  used  for  the  entry  so 
occasiopod.  It  is  intendeo  the  operations  sheet 
provide  adequate  Inrormavlon  from  its  Original,  as  kept 
3>'  the  operator,  and  not  require  reprocessing  prior  to 
utilization. 

Failure  Report 

The  use  of  a  failure  report  to  sufficiently  des¬ 
cribe  all  pertinent  circumstances  attendant  to  equipment, 
failure  is  believed  mandatory  in  order  .to  guarantee  proper 
isolation  and  count  of  unrelated  although  simultaneous 
eoulpaent  failures  (which  must  be  counted  aa  separate 
fuiliirsa  in  accordance  with  the  rules  for  data  handling 
w’-.ich  follow  the  description  of  the  required  data  forms). 
F-jrthermore,  the  use  of  an  adequately  c-omplete  failure  re¬ 
port  will  permit  maxim-jm  benefit  to  the  equipment  oanu- 
facturer  and  his  deslg*’  staff  if  remedy  is  needed  because 
of  failure  to  pass  the  Rell.-»bility  Test.  The  Failure 
Report  form  should  be  preprinted  for  ease  of  data  entry, 
inii  all  forms  must  possess  a  preprinted  ser.'.al  number 
for  reference  purpos.-js  and  acco'-ntablllty.  The  form  should 

11*2 


b«  deslmod  to  peralt  Initlol  data  entry  by  the  ‘tect  -oper«> 


and  f^.nal  data  entry  by  enginetrine  design  and  ataff  ae> 
tivitlaa.  Accordingly,  these  respective  portions  of  the 
Failure  Seport  form  are  identified  by  X,  XX,  XXX. 


Reported 


the  Test  Operator 


A.  Equipment  Failure  Identification  . 

1.  Cate  and  time  of  failure .  ‘ 

2.  Test  sequence  identification  at  time 
of  failure . 

3.  Identification  of  failing  equipaeot. 
by  Model  and  Serial  Kumber . 

4.  Name  of  observer  • 

5>  Specific  identification  of  teat  in- 
fllrumentation  and  facility  appXicabla 
to  failing  equipment  • 

6.  Total  test  time  accumulated  by  failing 
equipment  at  tins  of  fallura . 

B.  ■  failure  Symptoms 

Both  variables  and  attributes  data  on 
both  abnormal  and  normal  perforciance. 
parameters,  both  immediately  before  ' 
and  iscadiately  after  failure,  ■ 

C.  Reference  to  Other  Failure  Reports 

■  LiAt  other  equipment  failures,  if  any,' 
•  obaerve.d  elmultansouely  with  the  sub>  ' 
ject  equlpc-^nt  failure.  --  (These  data 
are-  valuable  to  guard  against  reasons 
for  failure  external  to  the  tested  ’ 
equipment;) 

Reported  by  'Repair-  Personnel  . 


A.  General 

1.  Time  and  date  failed  equipment  received  -' 
by  repair  personnel.  . 

2.  Kame  or  names  of  repair  personnel. 

B.  Confirmation  of  Symptoms 

1.  Method  of  test  employed. 

2..  Identification  of  test  Instrupsentation 
and  facility  used. 

3.  both  variable  and  attributes  data  (as 
applicable;  on  all  performance  parameters 
checked. 

4.  Cc.-n-nents  on  discrepancies  between  symp- 
t'jas  observed  by  repair  porscnnel  and 
syr.pnoras  observed  by  test  operator. 


m:: 
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C.  Id»ntifteatlon  of  Failed  Part  or  CowPonaBt  ‘ 

1.  Part  naic«,  ca'taiojc  number,  aanufacturer, 
and  Circuit  ay tool  wnich  must  uniquely 
identify  the  failed  part  within  the 
overall  eauipsent. 

Method  of  pair  test  used  to  eatabliali 
part  failure. 

3.  Identification  of  teat  instrunentation 
emoloyed. 

4.  Variables  data  cn  significant  perfomance 
paraueters  of  failed  part. 

D.  Maltiule  Part  failure 

1.  Identification,  similar  to  (C},-of  each 
additional  failing  part  which  can  be 
proven  to  be  a  secondary  failure  and 

•  -TSccasicr.ed  by  part  failure  identified 
under  (C).  The  actual  or  suspected 
mechanian  of  secondary  - fai lure  should, 
be  briefly  described. 

2.  .Identification,  similar  to  (C),  of  each 
additional  failing  part  which  cannot  be 
proven  to  be  a  secondary  failure  apd- 
occasioned  by  the  part  failure  identified 
under  {C) .  The  repairman  is  authorized 
and  directed  to  initiate  an  additional* 
failure ‘report  for- each  additional  thqugh 
unrelated  parts'  failure  found.  Referenes 
to  ehesc  failure  reports  should  be  includ 
on  the  original  failure  report, 

E.  Identification  of  Repairs 

1.  Identificatior.'and  past  history  (new, 

.  burned' In,  life  tested,  etc.)' of  .each 

replace.mer.t  part  used  for  repair,  with 
specific  reference  (viz.,  circuit  sympol) 
to  the  fa  ilea'  part  that  each  replaces. 

2.  Definitive  description  of  control  adjust 
n^nts  needed  to  reebtain  satisfactory 
equi,»r.ent  p-trfor-cance,  with  j'uatificatlon 
for  ad justsents  (other  than  operator 
controls)  in  terms  of  failed  or  replaced 
parts, 

3.  Variables  and  attributes  data  for  equip¬ 
ment  perforr.i-icc  follonlitg  rep.ii.r. 

4-  AccuiJiul&ted  operating  time  for  equipment 
during  t'nls  r.erair  cycle, 

Interrrct.gior:  of  t'r.e  Reason  for  Failure 

by  hcKtir  r-ersv-r..ncl  . 

^ •  ;uILLI’* re  i.'umber  Ass : gnrent 

T>  r-ef'-irate  7a iTcre  report  rust  exist  for 
every  primary  •; unrelated)  failure,  and 
•.i*it‘iin  the  reiiarlllty  t.?st  of  a  sample 
'■  f  eTJt.''"er.' •  each  f. a;  lure  mast  be 
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n«iffiben«d  ccnsecutively.  Since  It  i« 
presuned  that  a  sinfcle  repair  activity 
will,  procost!  all  -failed  equlpoents.  It 
is  probably  cenvenienv'  for  ccnsecat.ve 
failure  numbering  to  be  assigned  by 
the  repair  staff. 

Reported  by  Engineering  Peslyn  and  Staff 

]^er'sonn^ 

A.  CoRDonent  Analysts  • 

Results  o'  analysii  of  the  failed  part 
or  parts  including  a  descriptioii  of  the 
analysis  and  specific  findings  as  to  the 
contributory  cao'ies  rf  failure.  Tha 
electrical  and  physical  conditions  to 
which  the  component  was  exposed  oust  be 
related  to  the  failure  as  significant 
or  insignificant  as  causative  agents. 

B.  design  Analisls 

Results  of  mechanical  and/or  electrical, 
design  analysis  including  a  descriptxcn 
of  the  analysis  and  specific  findings  ae 
to  the  contrib'itory  causes  of  failu.re. 

Any  significant  external  conditions  should 
be  related  to  the  failure  as  causativa  or 
nbnrcausatlve. 

2 *  Recoir-endationa  for  Corrective  Action 

7ho  joint,  .'cordi'nated  reccamendations 
of  the  component  and  design  persenneJ. 
must  be  presented  to  pencit  specific 
consideration  for  assignment  by  manrge- 
ment  of  the  reeponsibility  for  taking 
corrective  action. 


Z.oult<!ient  Repair  sncct.  '  . 

The  Equipment  Ropair  3hc»t  is  designed  to  pensit 
koepl.ig  the  entire  test  histojy  of  each  tested  squipr.ent 
on  a  single  sheet,  In  order  that  widely  divergent  dif¬ 
ferences  in  test  behavior  between  equipments  may  be  easily 
recognized-.  Addltio;:8liy,  the  use  of  this  fom  will  be 
of  sotte  assistance  for  the  recognition  of  subseq-jent 
failures  prod-aced  by  an  earlier  and  I’nrescdied  cause. 
Furtheraore,  this  form  assists  .<n  Btetii’p  tne  requirement 
for  sufficient  data  collectlr-n  for  eroes-rhccking  pur¬ 
poses. 

The  heading  of  the  Equipment  Repair  Sheet  sho-ald 
certain  comrlete  idcntiflcatjon  of  the  specific  equipcent 
to  which  it' refers,  including  the  basic  equipment  serial 
nimber  as  w.'il  as  serial  numbers  of  sraj-or  units.  The 
heading,  rhowld  alr-o  contain  complete  .cferenae  to  the 
test  to  which  tne  equlpmeni.  is  iscing  subjected.  The  test 
petition  occupied  by  the  e-~,uipi.~.(.n‘.  du:'*r.g  teat  s.-.oulii  te 
ideatiflco.  dotation  should  be  entcrod  concer.nlr.g  any 
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tlgnificast  past  history  of  ths  mrtienlMt  •quipMct 
prior  to  tht  roliobility  tost.  Lastly,  tho  <lato  of 
InlliatloR  of  tho  tost  should  bo  ontorM* 

S«lo»  the  hOAilof,  tho  E^lposift  Bopalr  Shoot, 
should  oe  divided  iPto  ecluans  as  follows: 

A.  D.nto  and  tiao  oquipnent  reaovod  froc  tost  for 
repair. 

B.  Cate  And  tiAo  oqulpaent  returned  to  test.' 

C.  Elapsed  c  perati:>£*t  iaa-ceter  readied 
equlpc:ent  reaoved  frca  test  for  repair. 

O.  Approvisste  se:uaalatcd  operatinc  tiaa  durles' 

rep-ir.  .  .  - 

E.  Identification  nuabor  of  the  failure  necessitab'* 

Ing  repair. 

P.  Reference  to  all  other  failure  reportr,  if  any, 
Ihitiated  during  repair. 

■  ;  Onder  thi*  eolunn  headings  tho  fora  ohould  ha 
rulod  vith  a  R'iBl*tr  of  oquolly  spacod  borttonUl  linos 
with  sufflcloR-:  spacing  to  persit  the  uto  of  a  airglo  lino 
for  OBch  tnetanes  of  ropoir*  It  la  Intondod  that  upon 
eo«5>lotlon  -vf  Uo  tost  the  eevoral  oqulpaent  reoalr  sheets 
for  the  eeveral  equlpcientt  tested  aay  be  serutinisod 
siauitaneousiy  for  s  eoeparleon  of  tho  nuabor  of  fsllvros 
suffered  by  each  squlpsent,  snd  ths  total  tins  consueed 
in  asking  repairs.  In  addition.  It  will  bs  potsiblo  to  * 
provide  conti:n»ous  seoountablliiy  for  each  tested  ecylp- 
oent  during  the  test  by  ourvelllancs  of  tne  Ecuipowit 
Repsir  Shset  in  eon Junction. vitbthe  Cperetion  Sheet.  .  • 

Fsilure  Tecs 

An  Equiptte.v..  Psllure  Tag  Is  to  be  sfrixed  to  o' 
failed  equipceRt  by  the  'rst  ■7bftr<trcr  lasedlately  upon  foil 
ure  detect  ion.  The  tsg  Bust  .•efe-<»nre  page  .and  ilae  Bua- 
ber  of  t.ne  perriaeat  c.nTy  n:  •}.<?  Operation  Sheet  and  the 
Log  of  Failures,  xnd  as.ist  show  the  Pallure  Report  .fera 
serial  r.uaber..  Scare  nu.at’-te  prevtUed  for  entry  if  the 
repair  acc-wtiv  cf  the  pige  and  i:ne  nunber  of  the  appro¬ 
priate  entry  in  the  Equipnent  Repair  Sheet,  and  the 
raiJore  Report  serial  nuaberf  5}  for  any  acdlticcal 

part  or  roirpo.-.er.t  failures  d'seet'-ed  during  repair.  This 
tag  is  tc  be  rescv'.cd  by  the  test  upetator  upca  the  equlp- 
return  ;?  test  .fvilcwing  repair  whereupon  the  tag 
is  to  be  deiiveref  tc.  the  iorai  ajithcrized  governaeat 
representstire. 

Other  fjiiure  tags  are  « o  be  pe.'waRently  affixed 
ta  failed  parts  ar.c  •cccor.Vnts  by  the  repair  atllvity  a.hd 
'.hece  ♦ag.s  are  *c  .-eferente  tne  ser'al  number  cf  the  ap¬ 
plicable  Fa..i.'e  Report  for*. 
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U8t  of  roni» 

Frt^r  tc  b«glnning  tho  but  «ft«r  Ml«:tloo 

of  tho  equipaeit*  to  b«  tcstod.*  hooding  information  1$  to 
bo  inserted  ca  tho  Log  of- Failures  firm.  Operation  Shoot, 
*«d  Equipraen*  Repair  Sheets  tr2>e  oqu  poen*-  repair  sheet 
for  cacr.  oqulpaeit  to  be  tested) .  The  periodicity  for 
performance  •,;n«':iiini;  of  the  equiprer.ts  during  the  test 
must  be  estabiiahedl  Beginning  with  initiation  of  the. 
te.^t,  the  Operation  Sheet  is  to  be  continuously  maintained 
concurrent Ir  with  the  tieaeurements  and  readings  taken. 

At  tne  instajiie  of  the  first  ctserveo  failure,  the  test 
operator  must  make  an  entry  in  the  Log  cl'  Failures,  suit¬ 
able  entr>*  on  tne  Operation  Sheet,  and  initiate  a  Failure 
Report.  The  failed  eqaipir.ent  should  than  be  removed  from 
test,  without  disturbing  the  remaining  equipments,  and 
delivered  to  the  repair  activity  tngBthef*  with  the' 
partially  completed  Fail>:e  Report,  Curing  ana  at  the 
-  connlnflon  of.nesostary  repairs  (and  ultimate  vorificetion 
■  of  adequate  performance)- the  repair  personnel  ,u8t  maks 
nppii.tabj'  entr.es  on  the  previously  Initiated  failure 
Report,  must  initiate  additional  Failure  Reports  for  ad¬ 
ditional  independent  failures  foun'd,  if  any,  and  must  . 
make  an  entry  in  the  appropriate  Rquipment  Repair  Sheet. 
Thereupon,  the  eqairment  is  to  be  returned  to  the  test. 
Upon  re-installation  of  the  repaired  equipment  in  the 
test  facility,  the  tost  operator  should  make  an  entry  it> 
the  Operation  Sheet  to.  Indicate  satis.actoi;*;  cpeifatlcn. 

The  occas-lons  cf  subsequent-  failures  are  to  be  handled 
in  identical  .tanner.  At  t,he  time  cf  each  entry,  by  the  • 
test  operator  in  the  Log  of  Failures-,  he  should  check  Che 
tcc.*  chart  to  -deteraine  if  -a  decision  to  pass  or  fall  the* 
tested  sa-nple-can-be  rnade,  or  if  the  test,  must  cnnti’'.e,. 

At  such  time  as  a  decision  can  be  rescred,  and  provlde’d  ‘ 
ea;:)'.  of  the  ccu.pments  have  accumulated  a  test  operating 
time  eq-jal  to  or  greater  than  three  times  the  contract 
ipeolficd  mean-tiir.e-fcecKeen-failures,  the  test  can  be  ' 
discontinued.  If  a-deoisicn. is  ptssible,  but  one  cr  more 
,'{  the  tested  eooifaents  have  net  acc-omuiated  sufficient 
oper-itinp  time,  cniy  those  equipments  requiring  the  addi- 
t-iunal  operating  time  need  be-ocntimied  on  test.  ’  5a-}h 
aqulp-ments  as  are  then  deleted  free  tests  should  be 
referenced  to  tr.e  repair  activity  in  order  that  the  ap- 
p-irte’-ning  Equipment  Repair  Sheets  may  oe  closed  o-Jt  with 
arpropriate  entry. 

f.ubseq-uent  to  the  repair  of  equipment  failures 
the  ’■erair  .ictivify  sh-culd  fo.-ward  the  pertinent  failure 
reports,  tcref-her  with  the  failed  parts  or  components, 
to  t!:e  ".in.oonents  staff,  who  in  turn  will  re-forward  the 
-failure  reports  to  the  design  group.  (In  the  a-bsonce  of 
A  .'j'ri.i'ot!c,iLs  steff  «nd/or  u«;>ign  .group  the  reports  ’ should 
be  ft.. "warded  to  the  cognizant  en.rineer).  At  tht  com-  . 
pletlori  cf  the  test  ail  forms  sn-.-oic  be  reviewea  by  the 
local  a jti'orir.ei  rc-vernm-int  representative  and  then  re¬ 
leased  to  the  design  group. 

R-..'. as  r-»r  Data  Handling 

The  fcllivlng  rules  are  isandatory  for  governing 
•he  use  o;  ct-jle;t*?d  dita  and  the  aarr.er  In  which  it  is 
reflected  if  ^r.e  na.icion  !  eac.heJ  from  the  reliability 


t•*^  !•  tc  be  relii.  Ir.a3£aci.  «d  all  rule#  ar#  subject 
CO  interpretation,'  it  ;a  Int^ndeU  that  the  most  obvioue 
Interpretation  shall  apple,  and  disputes  shall  be  referred 
to  the  local  autrc'*isei  povrmment  representative  for  de> 
cistcn.  The  folloving  ruies  are  applicable; 


(1)  fit  eq-sipcect  failure  shall  be  defined  ae  in 
Section  I.A.2.  Inability  by  the  repair  activity  to  confine 
the  existence  of  eouJpeiest  failure  observed  during  equip- 
nert  reliability  test  stall  be  insufficient  grounds  for 
ceieticn  of  such  claiccd  failure  in  the  count  of  total 
falluree.  It  is  intef^ieS  ■•.ily  that  eonfinsetion  of  fail- 


»ire  ty  the  repair  activity  will  permit  better  aeete^ent 
cf  '.relied  repairs  ani  indication  of  possible  fault 
Ir,  the  .testing  facility^  Lack  of  failure  eonfirnatlon 
s.'.culd  instifate  close  reriev  of  the  tost  facility,  and  • 
It  the  latter  can  be  shovn  to  be  both  at  fault  and  to 
ccsrletely  account  fer  t.-.e  failure,  to  the  satisfaction  • 
of  t.he  .ocal  authorited  fOTernment  ,epresentativa,  then 
and  only  then  can  the  count  of  such  failure  be  MliQi.nated, 


1^2).  ■wie  actual  failure  of  f«rt8  cr  components 


e.in  only  be  established  if  the  repair  activity  can  unmis- 
cakably  demonstrate  that  such  items  no  longer  meet  one  or  ' 
mere  swdflcatlon  requireaehts .  The  existence  of  an 
eq«!:<-.£T,t  failure  under  ccr.oltloiis  where  no  part  or  ion- 
ro..-rt  tan  be  demons c rat ei  to  be  beyond  specification  iimltsi 
cu>t  be .  classified  as  eitr.er  a  design  or  workmanship  fail¬ 
ure.  As  such.  It  shall  ce  counted  in  the  total  number  of 
•equipment  falluree,  bat  details  of  the  clrcumstancee  shall 
be  deferred  for  close  study  to  tlie  design  or  quality  .con¬ 
trol  activity,  as  the  pase  may  be. 


13)  Peterolndticn^ thu  repalractivlt^  that 


fsore  than  cne  item  -in  a  failed  equipment .  is' both  beyond 
specififatio.;  iieits  ana  wi*i  inar.pendentXy  prevent  satls- 
factiry  eqaipnieci  perfcrsance  ?nali  occasion  the  repair 
or  •r«?la'-eB*ht  of  ea:h  item.  Each  s-.ich  repaired  or 
replnced  par;  or  comjwnrot  .sha'tl  be  .counted  as  a  separate 
♦'qulrmest  failure  'altrca^di  :hfc  several,  wore,  otsorred 
stEj'.tancoislyl  jrless  be  demonstrated  teyona  any  ■ 

questten  or  doubt  tr.at  Tr»-  failure  of  one  Hem  In  turn 
pro2\.ced-the  fal.ure  cf-cr.*  or  ai' re  other  items.  If  such 
proof  can  be  desenst rated  each  cep^ndent  failure  may  be 
classified  as  e  sfeccr.c&ry  failure,  and  as  'such  Is  not  to' 
be  counted  in  the  failure  ictals.  Adequate  proof.,  neces¬ 
sary  to  establls.'s  tr.e  seteniary  aapect  of  certain  of  the 
suliiple  failures  observe;  simultaneously  will  be  at  the 
discreticn  of  the  local  4u*biriied  government  representa¬ 
tive.  Av  least  j.te  p.'isary  and  'oun*. aole)  part  or  con- 
.t.'par.t  lailure  must  oui  a;  earh  Ir.etanie  of  equipment, 
repair  where  secondary  failures  are  claimed. 
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par; .  Turcr.e.'it .  or  Item  may  be  replaced 
inrolr-;  ;r.  relVabUtty  t^st  unless  every, 
".on:,  cr  :ie;  ;.ah  be  proven  t.v  be  outside 
•r.->“rcr.'“  iu.h  parts  i.r  compon'-'ni'.s  as 
.1  i.-.)'  rfison  but  do  not  fail  outside 

--.-.net  b'  repiacec,  .  &}ch  in-- 
r-.e-.-  u.:.!#:  s  •  1.  ;onruti<;n^  fnall  be 
r.ury  fa;...--  ari  shall  be  called  to  the 
l;:al  a.' '..Tiled  r.c/ernme::t  rspreGenta* 
;u;prsu:t  fai-.-'-s  found  tv  e.tlst,  and 


I.J 


T  fc-*)  j  Jia??  ■»  if  *  V  T  w/  jr*.  ttu  trj  ^ 


"wa  -jr  -v*  r-*  t 
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no  p«rt  or  comoonont  eon  to  proven  to  bo  outsld*  of  apte- 
iflcatlon  Halts,  then  the  equlpoent  shell  be  repaired  to 
return  It  to  adequate  operating  condition,  and  the  epee* 
Ification  for  each  ilea  repaired  or  replaced  shall  be 
altered  such  as  to  reflect,  out *of •tolerance  condition  to 
the  satisfaction  of  the  local  authorised  governaant  rep> 
reseniatlve.  The  failure  count  for  such  repaired  or 
replaced  items  shall  be  In  accordance  with  rule  [))  above. 


{•))  No  preventive  .miintenance  is  allowable  during 
reliability  test  nor  o'lring  actual  equtpcent  repair  unless 
apeclfloally  authorlied  by  contract  with  respect  to  this 


«iuinvriz«>Q  o/  Cv'nvravi.  wit.n  vu  7ei;iB 

test.  .(Readjustment  of  operator  C''ntrels  is  not  considered 
preventive  enaaca) .  Antic.lj>%tton  of  failure  shall  in 


«  oil  «  A  V  TJ  *w*j*^v*  av»*  wi  laaa^uav  c»ll«t  f  ^ 

no  case  b*  Justification  for  any  preventive  maintenance. 


(6)  All  questions  and  disputes  arising  shall  be 
referred  to  the  local  auth.orlzed  government  represents-, 
tlve  for  decision. 


(7)  In  initiating  tft«  test,  th*  selected  equip¬ 
ment  sample  shall  be  irstalled  I'n  the  test  facility  and 
operated  for  only  that  length  of  time  necessary  to  es-.' 
tabllah  that  the  facility  is  workii.g  properly,  and  that 
adequate  facility  adjustments  and  taiiorations  exiot. 

Up  to  this  point  sccum.-ilated' equipment  cperating  tlae 
does  not  count  toward  the  test  ;ar.d  similarly  any  equip¬ 
ment  failures  may  be  repaired  wlinout  failure  count}. 
Thereafter  the  test  shall  btgir.  tna  all  cperating  time  in 
the  test  facility  shall  be  counted.  If,  during  the  course 
cf  the  test,  facilliy  difficulties  are  encountered  neces¬ 
sitating  equipment  ope.-atlon  in  the  facility  for.  experi¬ 
mental  purposes,  the  teotea  equipmert( s)  shall  be  replaced 
With  ether  like  equlcme.nt '  s)  not  under  test  for  euch. ex¬ 
perimental  period.  •• 


(8)  It  shall  be  permissible  for  the'  repair  ac¬ 
tivity  to  operate  any  equipment  following  repalre  thereto 
for  any  deoJred  length  of  rime  (prifr  to  reoiimption  cf 
te.*it)  no  'may  seem  pertinent  to’ g-oarir.tee  that  the  true 
cause  ol  equ'p'cert  failure  has  been  establlshad  and  e.ila- 
Inatcd,  This  s.haii  not  be  construed  to  grant  permission 
for  the  repair  activity  to  Inordinately  delay  returning  tc 
the  tejt  such  equipment  or  equipaer.ts  as  appear  to  have 
abnorwally  high  rates  of  failure. 


(9)  Requirements  fer  action  on  data  taken  snail 
be  in  accordance  with  the  instructions  enumerated  und<*r 
the  iioadtng  "Use  of  Fertts." 


(iO)  It  shall  be  pemiissitle  for  the  contract! 
'cr  tc  the  tost,  to  perfor.m  a.ny  desired  aetugging 
TBtio.Ts,  preventive  maintenance,  or  repairs. 


(11)  .Rules  and  procedures  ior  needed  repair,  i 
iicer:' r  t ,  ar.-'/or  ctlioraticn  cf  f.e  test  feoiiity,  t 
ce  surir.r  tf.e  t-st,  .must  oe  e.tt.cijated  anc  estac- 
i  tv.i,  rv.nj.;ct  to- the  atorova;  cf  tr.e  pr-ocv.nrvf  ager 
..'r  to  ’.T  t  i.iti.jn  of  tne  test.  A;,  n.^cvel  cf  ;.uiiit'.  c 
.'ice.e.i  the  test  n;.-,/  aelev.^ted  to  the 

.  il  ijut lied  dovernm.er.t,  reprener.nati ve. 
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(12)  Any  data  taken  during  the  teat  which  require 
arbitration  and/or  resolution  nust  be  resolved  to  the 
satisfaction  of  the  local  authorleetl  government  repre¬ 
sentative  following  the  data  occurrences.  No  data  once 
resolved  may  be  altered,  althou^  additional  clarlfyuig 
data  entry  may  later  be  made  lo  order  to  assist  la  the 
consideration'  given  by  the  local  authorised  government 
representative. 

(13)  No  official  tests,  may  oe  re-run  on  the  same 
or  a  new  sample  from  the  same  pilot  production 
vcs-ltlve  action  consisting  of  design  change,  modification, 
cr*  rework  actually  related  to  obaervad  failures  from  the 
f-.rst  test  has  been  applied.  The  benefit  of  early  un¬ 
official  test  Is  to  indicate  the  need  for  re-work  prior  . 
to  tubsxidsiou  for  official  test*  No  action  taken  (repalri. 
re-vork,  etc*,)  with  respect  to  any  or  every  equipment  in  a 
lot,  following  an  official  failure  to  paas  the  test,  c«a 

ce  considered  as  justification  for  avoidance  of  a  sub-  ■ 
sequent  official  test  in  order  to  establish  acceptance.  . 

(14)  Rules  governing  anticlpatibl.  interruption  to 
test  shall  be  established  prior  to  initiation  of  test 
Insofar  as  possible,  and  once  established  should  be  followed 
except  by  perolssloa  of  the.  local  authorised  government 
representative.  Test  validity  Is  not  abridged  by  te*b- 
Inc  on  a  single  shift  basis  nor  by  interruption  over 
weekends.  Failed  equxusent  removals  should  be  made  so  a» 
to  cinimise  ei’fect  on  raealnlng  equlpoenta  (such  aa  at 
the  appropriate  time  durlug  a  cycle  of  teaperatur*  ex- 
t-emes). 

2.  Longevity  Evaluation  Methods  and 

Procedures  -  ' 

Reference  to  Figure  1  and  the  definitions  and 
other  cons.lderationa  presented  In  Part-  1  of  this  report 
indicate  that  equipment  longevity  may  be  evaluated  in 
either  of  two  ways.  Equipment  longevity  may  be  measured 
to  be  boat  total  normal  operating  period  terminating  at 
the  onset  of  wearouf  where  tno  actual  average  KTBF  no 
longer  meets  the  specified  MTBF;  the  terminating  cri¬ 
teria  here  is  the  undeslred. change  in  ftiilure  rate. 

Also,  when  a  miniauiu  equipment  longevity  is  specifaed, 
the  equipment  may  be  evaluated  to  prove  Its  acceptability 
for  this  specified  length  of  useful  operating  life  by 
operating  for  such  a  period  and  decenrlr.lng  that  the 
avejage  .MTBF  docs  not  fall  short  of  that  specified 
during  su-ch  operation.  Here,  the  terminating  criteria 
is  tljc  specified  longevity  period  provided,  of  course, 
that  the  actual  average  MTBF  does  not  previously  fall 
belcw  thit  MTflF  specified.  It  is  anticipated  that  the 
latter  t)pe  of  test  will  be  called  for  most  often.  In 
either  ca:e  the  liraiflug  KTBF  for  the  longevity  test 
and  tne'mouhod  for  assessing  the  resultant  MTBF  must  be 
specified. 

Whereas  the  rellabll ity-lndes-te-st  operating 
fericd  on  each  eouip^e.nt  is  rel.Ttively  short,  usually., 
not  exceeding  three  to  five  failure  periods  on  the 
a.-er-re,  t.ne  lc>ng<'Vlty  to.et  coeratlng  period  (on  each 
ri.-qiL«'es  .iot  less  t.nsn  approximate]/  twenty 


and  upward  failure  periods.  During  the  pilot  produc'v 
tion  contract  period,  there  maf  be  inauffieient  tiae 
available  in  -which  to  coaplete  the  longevity  tests 
without  so  providing  in  the  contract.  However,  since 
it  is  desirable  to  initiate  the  beginning  of  the  longer^ 
ity  test  at  the  earliest  possible  date,*thu8  providing 
for  earliest  resultant  decisions  at  end  of  test,  the 
longevity  test  should  start  during  pilot  production  and 
continue  through  production  and  be  so  specified  in  the 
contracts.  The  longevity  evaluation  nethods  and  pro> 
cedures  established  herein  provide  for  this  extension 
or  overlap  since  the  evaluation  technique  la  identical 
for  both  pilot  production  and  production  thereby  becoalng 
directly  applicable  to  either  or  both  —  singly  or  to¬ 
gether. 


(a)  Sample  Selection 


Possibilities  for  sample  selection  are  limited 
by  the  small  number  of  eo.ulpQente  usually  available 
early  la  the  contract  period  and  by  the  dastnictivt  nature 
of  the  tests.  Equipments  may  be  aelected  in  any  sequence 
desired.  Each  should  have  demonstrated  its  ability  to 
perform  properly.  When  circumstances  dearnd,  it  shall 
oe  permissible  to  select  an  equircsent ■ ( and  associated 
reliability  data)  having  successfully  completed  the  Re¬ 
liability  Index  Evaluation  of  Fart  II. 6.1. - 


The  contracting  agency  shall  make  an  election  a* 
to  the  nu.mber  of  equipments  to  be  assigned  to  the  longaV' 
Ity  best.'  .It  is  to  be  noted  that  the  confidence  level 
of  test  outcome  will  vary  directly  with  the  number  of 
equipments  on  test.  This  factor  must  be  weighed  against 
the  length  of  operating  time  either  specified  or  ex¬ 
pected  and  the  relative  degree  of  equipment  deet.'uetion 
involved  in  the  test.  As  a  limit,  ths  minimum  number  . 
of  equipments  on  test  should  never  be  less  than  two. 
Furt.heraore,  except  for  repair  or  emergencies,  not- lees 
than  this  number  of  equipments  shall  be  under  test  ■ 

(once  started)  at  all  times  during  the  entire  duration 
of  contract,  unless  otherwise  specified  therein^  Ac¬ 
cordingly,  a  newly  selected  test  equipment  will  replace 
each  longevity  tested  equ}.p»nent  immediately  upon  the 
completion  (acceptance  or  reJe;tlon)  of  tt.at  tested 
equipment.  See.  also,  the  Dlsuussion  Section  III.B. 
later. 


(b)  Environmental  Specification  and  Test  ^  ' 
Conditions 


T'ne  longevity  test  environment  and  related  con- 
diticna  shall  be  id-ntical  In  all  details  to  those 
specif  lea  by  the  contracting  agency  for  the  Hellabllity 
Index  Evaluation,  see  IX, B.  l-o.  This  la  s  req'-ireBent 
in  order  to  gain  the  benefits  of  test  standa.'disatlon 
whereby  feed-back  data  nay  be  applied  and  tr.e  opportunity 
is  provided  to  comp>Aro  even  unllxe  equipments  under  the 
sa-r'-i  cta.-.daralzort  conditions. 


(c)  Test  Procedure 


T.-’.is  1.-3  a  test  procedure  not  unlike  that  stipulated 
F.fliaoility  Index  Evaluation  except-tnat  in  erder 
■  jw  Ic-nge-vily  capability  ( pe.cercily  wlfo 
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fetr  test  equlpnents)  It  Is  not  pracjtlcal  t«  use  the  ac> 
quential  analysis  (and  Table  2}  as  specifically  described 
in  Section  II. B.  i-e.  The  longevity  test  procedure  aust 
additionally  provide  inforoatioc  on  the  early  wearout 
type  of  failures,  not  ordinarily  found  in  the  Reliability 
Index  Evaluation,  thus  providing  needed  operational  repair 
and  maintenance  logistic  (and  possibly  modification)  in¬ 
formation.  Furthennore,  the  piocedure  is  the  same  ragard- 
less  of  which  test  termination  criteria  is  specified. 
Specifically  the  test  procedure  is  based  on  a  time  between 
failure  averaging  technique  which  describes  the  extent  of 
Nrrsr  change.  Under  the  specified  test  conditions  the 
technique  provides  s  determination  of  approximate  equipment 
KTBF  at  the  time  of  each  failure.  Should  the  equipment 
MTBF  so  determined  be  found  less  than  that  specified  for  the 
test,  during  the  longevity  test  terminated  by  a  specified 
longevity  interval,  the  equipment  is  rejected  as  failing 
to  pass  test.  If  the  .determined  MTBF  was  equal  to  ox* 
greater  than  that  originally  specified  for  the  test 
th.roughout  the  specified  longevity  interval,  then  the ' 
equlcment  would  be  accepted.  Similarly,  when  the  test 
termination  criteria  is  onset  of  wearout,  this  longevity 
interval  Is  measured  to  be  that  period  terminated  when  the 
time  between  failures  averaging  technique  first  describes  ' 
the  MTBF  to  be  Just  less  than  that  spscified  for  test. 

•  .  . 

1.  The  sample  of  equipments  for  longevity  test 
may  bs  selected  in  any  manner  at  the  contractor’s  dis¬ 
cretion. 

2. "  The  selected  equipments  shall  be  fitted  with 
elapsed  operating  time  maters,  which  will  indicate  tkc  total 
hours  of  test  time  accumulated  by  the  equipment  to  wfileh 
attached. 


Ml 


Ml 


3 .  ■  Logs  shall  be  set  up  for  uss  during  the  test 
'  one  for  each  equipment  and  assigned  by  equipment  serial 
number,  which  have,  columns  assigned  to  tlie  following: 

(a)  Test  positicn  niunber. 

(b)  Consecutive  number  of  failiu*es  ob-  ' 
served. 

.  (c)  Date  and  tlms  cf  failure  obseryaflon . 

(d)  Accumulated  operating  time  at  time 
of  corresponding  failure  in  colxian 
(b). 

(e)  Column  (d)  less  twelve  times  the  limiting 
test  MTBF. 


(f)  Namber  of  failuraa  occurring  within  the 
time  Interval  between  columns  (d)  and 
(o),  by  inspection. 


The  value  of  limiting  test  KTBF  .shall  be  taJten  as  0.5 
times  t!iat  contr-ict  specified  MTBF. 


({)  Accumulated  oparaciitg  time  at  failure 
number  column  (b)  mlnua  twelve  (l.e., 
accumulated  hours  Indicated  in  column 
(d)  for  the  twelfth  previous  failure). 

(h)  Time  Interval  for  last  12  failures  <* 
column  (d)  -  column  (g). 

(l)  Test  MTBf  •  column  (h)/l2. 

(J)  Remarks  —  This  column  should  have  ample 
space  to  describe  the  technical  details 
involved  by  virtue  of  the  failure; • 1. a. , 
type,  value  and  rating  of  failed  bom- 
ponent(s);  locatlon(sT  in  circuit; 
probable  cause(s)  of  failure;  repair 
action  taken,  etc.  More  details  as 
necessary  may  bi  kept  in  an  additional- 
failure  detail  log  (Log  of  Failures) 
assigned  to  this  specific  equipment. 

Crost  reference  shall  be  the  consecutive  ’ 
failure  nuiiiber. 

if.  Criteria  for  equipment  failure,  during  longevity 
test,  shall  be  established  by  contractual  agrccsant  prior 
to  test  in -accordance  with  the  Definition  Section  I'.A.2.. 

5.  The  test  shall  begin  only  after  .both  the  equip¬ 
ments  to  be  tested  and -the  test  instrumentation  facil-itles 
have  had'  suitable  operational  check-out. 

6,  Should  equipments  having  satisfactorily  cor* 
pleted  the  Reliability  Index  Evaluation-  be  selected  f''r  this 
longevity  test,  all  previous  operating  and  failure  history 
must  be  transferred  to  the  logs  of  paragraph  3  above  and  be 
found  complete  and  acceptable  therein.  ■ 

7.  At  the  Instance  of  each  failure  a  log; entry  * 

Is  to  be  made  on  a  single  line  vlth  .observed  data  for  each' 
of  the  ''olumns  in  paragraph  3  above. 

8.  On  the  occasion  of  a  failure,  the  fal'led  equip¬ 
ment- is  to  be  removed  and  repaired  vlthcut  Interrur.tlor  of 
the  test  of  other  equipment?  on  test  which  are  continuing 
to  meet  test  performance  requlrewente. 

9.  Uion  the  decision  that  a  failed  end  ret  aired 
equipment  has  been  returned  to  representetlve  operative 
condition  it  ahnll  be  returned  to  tej?  vtthout  Interrupt 
tlon  to  the  equipments  continuing  the  test,' 

10.  The  ao9er.ee  of  one  or  -xere  e ^ulpir-c-nt-s^  for -the 
purpose  of  failure  repair  shall  r.'.t,  affect  the  ability  to 
cake  decisions  from  the  log  data  previcuoly  obtained. 

11  The  early  InJliatc  for  -cnti-uing  t»‘St  will 
be  the  value  of  the  nom'oer  Inol'-ated  Ir,  co’.umn  (  f)  of  the 
log  in  '3  above.  Value-''-  1?  or  loss  inil'’a';e  the  specified 
test  -V.Tfcr  limit  has  m»t  cr  cx''’--d-‘a  arl  test  shcul-i 
cor.tlnuo  (unles.®  the  1  laitir  g  specif  led  teta'j  •?r<'-r-nt  Ing 
time  has  beer>  reachei).  Values  i'-.  or  greater  indicate  that 
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th*  specified  test  MTBf  limit  be a  oot  been  met  and  either 
the  eqaipment  failed  to  have  the  specified  -looswvitjr  or 
that  the  onset  of  wearout  has  been  reached*  Slallarlv, 
.cclt>mn  (i)  jrlelfs  the  resultant  test  KTBF,  yhieh  may  be 
directly  compared  with  the  limit ln({  test  IITBP.' 

12.  While  the  test  HTBP  (uclumn  (1))  thus  ob¬ 
tained  is  used  as  the  ueasuring  criteria  for  continuation 

or  termination  of  test,  *lt  also  is  a  mathematically  smoothed 
treno  indicator  of  reliability  iroex.  As  such,  a  plot  of 
these  values  with  time  will  yield  a  smoothed  plot  of  the 
eo.uipaent  life  charaotoristlc.  (The  time  coordinate  value 
shall  be  taken  as  the  meaii  value  of  the  int«i«ai,  colusin 
(h))*  .  .  • 

13.  The  information  given  in  columns  (e)  and  (f) 
is  useful  immediately  by  the  data  tsxer  for  status  of  test 
detsnaination.  However,  they  are  valid  only  after  12-  ' 
failures  have  occurred;  accordingly,  in  this  early  period 
thev  shall  not  be  used.  Slnllarly,  column  (i)  also  is 
valid  only  after  tvelve  failures.  Bovever,-  the  approvimats  • 
trend  of  KTB?  may  be  determined  in  this  early  period  by 
dividing  the  value  of  column  (d)  by  that  corresponding  in 
column  (b),  m  this  early  ps-rlod  an  insufficient,  test  MTBP 
should  be  recognised  as  occurring  in  the  ’  de-bugglng*  period 
ar.d  therefore  not  be  used  as  a  longevity  test  limiting 
.criteria. 

■  (d)  Data  Handling  •  " 

The  recomnended  rules  and  procedures  for  loqgevity  ■ 
test  data  handling,  as  set  forth  herein,  have  been  estab- 
llehed  to  not  only  provide  longsvlty  test  criteria  but  •  .  •  • 

also  to  provide  reliability  failure  data  and  related' 
information  leading  to  a  more  complete  understapdlng  of 
the  basis  on  which  improved  reliability.  Is  founded. 

1*  The  pertinent  basic  premises  of  tbs  longetrlr 
ty  test  data  handling  rules  and  procedures  are  in  aecord 
with  those. of  the  previously  described  premises  for  Relia¬ 
bility  Index  Bvaloatlou.  Speciiically  Items  1,  6,  7,  and  8' 
under  the  heading,  II. B.  1-d  (Data  Kandlihg},  apply  equally 
here. 

2.  The  recommended  test  does  not  immediately 
lead  to  a  numerical  measure  of  the  (lot)  longevity  but 
rather  establishes  either  the  fact  that  the  tested  units 
themselves  equal  or  exceed  th»  specified  longevity,  or 
that  they,  indicate  the  unset  of  wear -out  at  a  partictiiar 
time  Interval. 

3.  It  is  essential  thet  all  equipment  repair, 
during  tne  longevity  test,  be  performed  by  the  least 
prejudiced  ana  best  qualified  repair  personnel  and  that 
euch  work  be  p'<»rfonsed  under-  the  surveillance  of  the 
outhorited  go\ ernsifr.t  representative  (th#  Inspector  *n 
charge  or  hie  uelegate  when  appllcasisj. 

h.  RecoBaenditions  for  data  handling  are  made 
vn  the  baeis  of  prescriblj-.g  the  Kininum  data,  handling  es¬ 
sential  to  the  above  pjcmises.  Recording  of  data  or  data 
croceselng  dooit tonal  to  that  rr-cem-tenaed  herein  is  per- 
sissiblc  9'’d  nerl  bo  governed  by  tne  desire  to  perform  a 
ncTs  efficient  and  complete  longe--lty  test. 


5.  Dtta  takan  dariag  the  longevity  test  shall 
b«  at  least  that  necessary  to  ccnpleta  fire  kinds  of  data 
forme.  The  fire  data  font  will  be  identified  as  follows: 


(a)  Longevity  Log  cf  yailures. 
fb)  Operation  Sheet.- 
is)  Failtire  Report. 

(d)  Equipment  Repair.  Sheet. 

(e)  Failed  component  ausnary  analysis. 
Longevity  Log  of  Failurea 

The  Longevity  Log  of  Failures  is  a  form  containing 
all  inforsation  necessary  to  reacn  a- decision  as  to  whether 
the  tested  sample  passes  or  .falls  the  longevity  test.  In 
addition  to  those  items  listed  in  Section  II.B.-2-c  -  3,  It 
bnoll  have  a  heading  containing  customary  identification, 
including  complete  reference  tc  the  test  and  test  conditions,  ' 
test  facilities,  equipc...  type,  dste  of  beginning  and  of 
end  of  test,  name  or  lde....tflr8tlon  of  data  recorder,  and 
page  number.  As  before  much  of  this  can  be  placed  in 
secondary  documentation  provided  auch  it  prepared  prior  to- 
inltlstlcn  of  test. 

The  Longevity  Log  of  Failures  preferably  shall  be  a '  • 
preprinted  fora.  Following  the  heading,  the  foia  should 
be  ruled  into  the  necessary  ten  columns,  the  last  column 
f remarks)  should  be  as  large  as  ..actical.  Column  heaoibgs 
should  be  abbreviated  in  keeping  with  the  content  of  the 
column.  '  • 

Under  the  column  headings  the  fora-  shall  be  ruled 
horltr-ntally  with  a  number  of  equally  spaced  lines.  Ba-.b 
line  tllo^ng  sufficseat  space  to  permit  record Ing- of  ail 
data  pertaining  to  a  oparate  equipment  failure.  Totals  are  ■ 
'not  requir.'d  at  the  h-ottora  of  the  page.  Page  to  page  carry¬ 
over  of  data  may  be  made  In  a  8traieht-for»a,-a  manner  as 
from  line  to  line,  recording  shall  comply  with  the  re- 

qulreoenti  set  forth  in  the  previous  section,  lI.B,2-c 
(Longevity  Teit  Ptooedure'). 

Operation  Sheet 

The  Operation  Sheet  is  de.-<ifneH  to  permit  data  re¬ 
cording  of  such  a  nature  as  to  fora  a  log  of  the  signif¬ 
icant  activity  ol  the  te.st  oper«tors.  It  provides  neana  to 
C7-osf  check  for  the  existence  of  any  failure  Inadvertently 
uoStted  fre-a  the  I.c-nyevtty  Log  cf  Failures.  Further,  it 
permits  means  :or  arbitrating  any  contention  that  observed 
eqylpfBent  f.;l-jre  was  in  rmth  the  fault  of  the  test  fa¬ 
cility  rather  thais  tl.e  tested  equiroe.nt.  It  establishes 
ths*  presence  on  the  desired  routine  la*"!?  of  operating 
pereorr.el  thrcug.hout  the  duration  of  test. 


.Th«  htadlns  of  Cptntloa  Sh«et  should  eoatala 
means  for  identifiestion  of  the  test,  idantlfiesttOB  of 
the  eculpments  under  test,  date  spplicsble  to  data  (below),' 
and  page  number.  Reference  to  secondarf .  documentatxMi  to 
shorten  heading  entry  Is  permissible  on  the  same  basis  as 
described  for  the  Longevity  Leg  of  Failures. 


Under  the  heading  the  Crerations  Sheet  should  be 
divided  Into  columns  in  accordance  with  the  following: 


(a)  Line  cumber. 


(b)  The  2nd  column  should  be  for  local  tiae 
of  the  data  entry. 


(c)  Che  or  sore  coluat.s,  as  dseaed  neeesssty, 
should  be  provided  for  repeated  monitor*  ' 
ing  of  crivlval  environaeacal' parameters 
and  power  supply  parameters. 


(d)  A  group  of  columns  should  be  provided 

for  each  equipment  performance-  parameter 
monitored  cn  a  repeated  basis  during  the 
test.  ' 


Each'  column  group,  as  described  in  (d) 
above  should  contain  as  many  colusdis  aaj 
there  are  ecuipnents  assigned  to  simul* 
tacoous  test^  The  width  of  each  coluam 
should  bw  sufficient  to  permit  the  entry 
of  a  numerical  value  for  the  perforaanea  . 
parameter  monitored,  or  a  check  mark  if 
acre  applicable.  The  numerical  parameter 
is  preferable  to  the  check  mark  because  of 
its  greater  guamntee  of  operator  atten¬ 
tion.  .Tr.e  last  column  should  be  for  the  •' 
name  or  initials  of  the  data  recorder  - 
making  the  data  entry. 


Seneath  the  column  heading,  The  Operations  Sheet 
should  be  ruled  with  hen  cental  lines  to  ^rmit  one  line 
to  be  used  for  each  obsenatloa  of  the  sample  under  test. 

It  Ir  presumed  that  equitccr.t  operating  in  the.absepce  of 
failure  will  be  routinely  checned  on  some  periodic  basis 
such  as  one  each  hour,  or  once  each  15  minutes,  etc.  It 
has  betn  found  that  periodic  data  entry  peiilts  far  acre 
•  accuracy  than  other  tsch:.iq..es  such  as  "continuous  scrutiny 
with  data  entry  only  upon  cctasion  of  Irregularity.'  Should 
attentJort  be  drawn  tc  equicce.-.t  fall”~€  between  Intervals 
of  regular  data  taking,  tr.e  .-•xt  ava.iable  line  on  the 
Operations  Sheet  should  be  used  fjr  the  entry  sc  occaslcacd. 
It  is  intended  that  the  operations  sheet  provide  adequate 
liiform-Jtion  from  its  origlr.il,  as  kept,  by  the  operator, 
fc.-.d  not  requlro  reprocessing  prior  to  utilisation. 


Fiilure  Report 


The  use  of  a  rer*.'rt  to  describe  sufficient¬ 

ly  s'*!  pert;n«nl  circ  ’"l .^.r  .'ss  ai te.odHnt  to  eiv.ipaent 

13  helleved  Ear.i.-.i  .*c  .7rawr  to  guirar.'.ee  proper 
Istlailon  «‘‘nd  count  of  u.-.;  • .  ■ted  although  si  'ultar.eoa" 

— mn-  ♦•eUiire«  (whith  r-st  be  counted  ss  separate 
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fallu!«9  In  aeeordanca  wir.h  th«  rul«s  for  tfato  handling 
vhic;:  fellow  th»  dasertptlon  of  tho  raqulrad  data  fom&). 
Furthereerc,  the  use  of  an  adequately  co«ple*.e  failure 
report  will  penalt  fflaximuic  benefit  to  the  equipment  naru- 
f&rturer  and  his  design  staff  If  reaedy  la  needed  because 
of  failure  to  pass  the  Longevity  Test.  The  Failure  Hepert 
fora  should  be  preprinted  for  ease  of  data  ent.7,  and  all  . 
forms  oust  possess  a  preprinted  serial  number  for  reference 
purposes  and  accountability.  The  form  should  be  designed 
to  permit  initial  data  entry  by  the  test  operator,  subse* 
cuent  data  entry  by  equipment  repair  personnel,  and  final 
data  entry  by  engineering  design  and  staff  activities. 
Accordingly  these  respective  portions  of  the. Failure  Report 
fora  are  identified  by  I,  11,  III. 

I .  Reported  by  the  Test  Operator 

A.  Sqalpment- Failure  Identification 

1.  -  Date  and  time  of  failure. 

2.  Test  sequence  Identification  at  tioa 
.  of  failure. ‘ 

3.  Identification  of  falling  equipment 
by  model,  and  serial  number. 

4.  Kama  of  obaerver. 

5.  Specific  identification  of  test  In¬ 
strumentation  and  facility  applic'.ble 
to  failing  equipment. 

6.  Total  test  time  accu-iiulated  by  falling, 
equipment  at  time  of  failure. 

5.  Failure  Symptoms 

Both  variables  and  attributes  data  on  both 
abnortai  and  normal  performance  par^nieters, 

•  bath  iK'jedlateiy  before  and  lamed  lately 
after  failure. 

C.  .Reference  to  Other  Failure  Reports 

List  ether  equipment  failures,  If  any,  ob¬ 
served  sirultar.eously  with  the  subject 
e';uip.xer.t  failure.  {These  data  are  valuable 
to  gjara  against  reasons  for. failure  externa.., 
to  tn."  tested  equipment.} 

II.  P.er-orted  by  Reoair  Per.to'‘nel 

A.  I'tneral 


1.  Ti-me  ir.j  date  failed  equipment  received 
by  reralr  f-erscnnel. 

Z.  Name  or  na-t-s  of  repair  peraonn-i. 
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B.  Coaflrmstiott  of  Syuptoas 

Method  of  test  enployedi 

2.  Identification  of  test  instrumcotatloa 
and  facility  used. 

3.  Both  variable  anU  attributes  data  (as 
applicable)  on  all  performance  paraoetera 
checked. 

4.  Commentu  on  discrepancies  between  syaptoms 
observed  by  repair  personnel  and  symptoms 
observed  by  tesp  operator'. 

C.  Ide.>tlfication  of  failed  Part  or  Component' 

1 •  fart  name,  catalog  ntuaber,  manufacturer, 
and  circuit  symbol  which  must  uniquely 
identify  the  failed  fart  in  the  overall 
equipment. 

‘  ?.  Method  of  part  test  used  to  establish  \  • 

part  failure. 

3.  Identification  of  tost  instrumentation 

aiaf>loyed.  • .  . 

4.  Variables  data  on  significant  performance 
parameters  of  failed  part. 

D.  Multiple  Part  Failure  '  .  ■ 

1.  Identification,  similar  to  (C),  of  each  ad¬ 
ditional  falling  part  which  can  be  proven 
to  be  a  seconda.-V  failure  and  occisloned 
by  part  failure  identified  under  (C).  '  The 
actual’  or  suspected  mechanism  of  secondary ■ 
failure  should  be  briefly  described. 

2..  Identification,  similar  to  (C),  of  each  ad¬ 
ditional  failing  part  which  cannot  be- 
proven  to-  be  a  secondary  failure  and  oc- 
ca'sioned  by-  the  pert  failure  Identified 
under  (C).  ’’’he  repairman  is  authortzfd 

and  directed  to  Initiate  an  additional 
failure  report  for  each  additional  though 
unrelated  parts  failure  found.  Reference 
■  to  these  failure  reports*  should  '  e  In¬ 
cluded  on  the  original  failure  report. 

o*  Jdar.tif Ication  of  Repairs 

1.  Identification  and  past  history  {new, 
b-tirr.ed-ln,  life  tested,  etc.)  cf  each  r*- 
plaremc-nt  part  used  for  repair,  with 
specific  reference  (vis.,  circuit  symbol) 
to  the  failed  part  that  each  replaces. 

2.  Definitive  desoriptlcn  of  control  adjust- 
•  meats  r..:9dei1  to  reobtain  s-itlsfactory 

equijtmeni.  ferfor.’SAnce,  with  Justification 


ise 


tor  adJuftamfeB  (otbar  than  oparator 
eontrola)  in  taraa  of  fallad  or  raplaead  - 
parts. 

3..  Variablaa  end  attrlbutos  data  for  aqulp» 
sent  parfomanea  following  rapair. 

4.  AceuEttlatad  operating  tlaa  for  equipmant 
during  this  rapair  ojrela. 

F,  frternretatlon  of  the  Haason  for  Fallura 
by  Repair  Peraoimai 

C.  Failure  Kuaiber  Aeslannant 

A  aeparc.ta  failure  report  mist  exist  for  oyorf 
priaar*  (unrelated)  fallui'a.  and  within  tna  . 
reliaollity  test  of  a  aaapla  of  aquipnants  each 
failure  zust  be  nuobared  eonaeeutivaljr.  Sines 
it  la  presumed  that  a  single  repair  aotivitp 
will  process  all  failed  equipmant a.  it  is 
probably  convenient  for  consecutive  fallura 
numbering  to  be  assigned  by  the  repa.lr  staff. 

Ill .Retwrted  by  Engineering  Deslm  and  Staff  Personnel 

Rdeulta  of.  ot  Comments  From,  Analysis  of  the 
irailec  fart  by'-t'ne  Conponents  Staff  ' 

B.  ConHients  Based  on  Failure  Analysis  by  the  Deslm 
Group 


C.  Peterminatlon  of  Part  Failure  Catego^r  l.e.. 
)*rl^r/  py^econclarr  t^allure.  by  beslim  Greuj 
witL  Apprcval  of  ^^uthorlteyoWernce^.t  Inspectep 

Optimum  subsequent  use  of  part  fallura  data  will 
require  determination  of  failure  category,  primary 
or  secondar)',  for  each  failing  part;  Since 
secondary  failures  cay  be  ellmlTiated  or  reduced 
by  improved  design  of  the  part  (or  associated 
circuit)  initiating  the  primary  failure,  the 
parts  In  the  secondary  failure  category  may 
not  necessarily  In  themselves  be  directly  con¬ 
tributing  to  the  cause  of  failure  and  th# 
attendant  reduced  equlpcient  XTBF.  The  more 
important  redesign  or  modification  viewpoint 
being  dstersliiatioD  and  elimination  of  causa 
of  the  associated  primary  part  failure.  This 
will  be  covered  in  more  detail  later  under 
Failed  Componaot  Suiosary  Analysis. 

Enuipcent  Repair  Sheet 

The  SquijHMnt  Repair  Sheet  Is  deslped  to  permit  keep¬ 
ing  the  entire  test. history  of  each  tested  equipment  on  a 
single  sheet,  in  order  that  widely  dlvergeiit  differences 
in  tejt  behavior  between  equipments  may  be  easily  recog- 
rlzed.  Aadltlonally ,  the  use  of  this  form  will  be  cf  soma 
assistance  for  the  recognition  of  subsequent  failures  pro- 
ducen  cy  an  earlier  and  unresedled  cause.  Furthermore, 
this  furs  assists  in  meeting  t>e  requirement  for  sufficient 
data  collection  fer  crcss-dhccklng  purposes. 


The  heading  of  the  Equipaent  Repair  Sheet  ahould  contaia 
eoaplete  identification  of  the  apeclflc  equipaent  to  which 
It  refers,  including  the  .basic  eqjlpoent  aerial  number  a* 
veil  as  serial  nuabers  of  major  units.  The  heading  sh^ald 
also  contain  complete  reference  to  the  test  to  tdtlch  the 
equipment  is  being  subjected.  The  test  position  occupl.cd  • 
by  the  equipaent  during  teat  should  be  identified*  Nota¬ 
tion  should  be  entered  concerning  any  significant  past  history 
of  the  pvirticular  equipaent  prior  to  the.  test.  Lastly,  tne  . 
date  of  initiation  of  the  teat  should  be  entered. 

Below  the  heading,  tho  Equipment  Repair  Sheet  should  b* 
divided  into  columns  as  follows: 

A.  Oats  and  time  equipaent  removed  from  test 
for  repair. 

B.  Data  and  tine  equipaent  retnraed  to  test. 

C.  Elapsed  bperating-tlme-aeter  '.*eeding  uhse 
•  aquipment  removed  from  test  for  repair. 

D. .  Approximate  accuaulatad  operating  time 

during  repair. 

£.  Identification  nuisber  of  the  failure 
necessitating  repair. 

■  F.  Reference  to  all  other  failure  reports, 
if  any,  initiated  during' repair*.' 

Under  the  column  headings  the  fom  should- be  ruled 
with  a  auitbtr  of  equally  spaced  horizontal  lines  with 
Sufficient  spacing  to  permit  the  use  of  a  single  line  for 
ism^y-  instance  of  repair-.  It  is  intended  that  upon  com- 
pieticn  of  the  test  the  several  equipment  repair  shssts 
for  tr.e  several  equipments  tested  may  be  scrutihl:.ed  simui- 
tanecusly  for. a  coaparlson  of  the  number  of  failures 
suffered  by  each  equipment,  and  the  total  time  consumed  in 
•".a King  repairs.  In  addition,  it  will  be  possible  to  provide 
continucus  accountability  for  each  tested  equipaent  during  ■ 
the  ’.est  by  surveillance  of  the  Equipment  Repair. Sheet  la  • 
conjur.ctlon  with  the  Operation  Sheet.  ' 


Tdliure  Tags 

An  Equipment  Failure  Tag  is  to  be  affixed  to-  a  failed 
eciiinent  by  the  te-st  operator  imaedlctely  upon  failure 
Ceic'.Mcn.  The  tag  must  reference  page  and  line  nuaber  of 
the  t'-rtiner*-  or.tiy  in  the  Operation  Sheet  and  the  Log  of 
ra:l’.res,  and  must  show  the  Failure  Report  fora  serial  number. 
Sr.rtce  -ust  oe  prcvjdeo  for  entry  by  the  rep.*  ir  activity  of 
•he  tac?  anc  line  n-jmber  of  the  approprlat..'  entry  in  the 
lqu:prent  .':«pair  Sheet,  and  the  Failure  Report  foraCs)' 

rett-eris)  for  .any  additional  part  or  component  fail- 
'.ret  c:-*.ect*d  during  r-pair.  T.M?  tag  is  to  be  rs’novcd  by 
the  te'-;  operator  'jcon  t.he  equif/tienf  3  return  to  test  feilow- 
'rr  '■'i'r.  ’rfhercupon  t’ne  t-'ig  la  to  be  delivered  to  tne 
-tutr-.r  ler  r-jv-ernPient  representative-  Other  failure  'sgs 
.-,re  •  'e  ;ersar.e-,*. "ty  af'ixe-d  to  :3ll“d  parts  and  i-cmp-tner.t s 
Te  ren-iir  a:*.i;-iiy,  and  these  t  »*s  are  to  reference,  t.i* 
t-'.-fi  r...“.r,er  of  tne  appl  le  F.->i  lore  Report  form. 
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PatlPtl  cdtr.ponfent 


Analyslt 


Failed  Coaponent  (part)  Soisaary  Analysis  rsport 
:)Vide  basic  data  for  determination  of  tlis  rails* 


forms  provide  basic  data  for  determination  of  tlia  rails* 
biXlty  capability  cr  parforaance  within  each  part  eatagory. 
AOQL'e  and  need  for  improved  da&ign  are  d>icerai£ad  therefrom* 
Cc*!'elatlcn  is  provided  between  field  and  factory  part  fail¬ 
ure  rotes,  etc.  Forms  need  not  be  pre-prlnted. 


The  heading  of  the  Failed  Component  Summery  Analysis 
form  (equipment  sheet)  should  contain  meana  fo**  <d*nt.lflr.aftl'»n 
cf  the  test,  type  and  serial  number  of  the  equipment*  data 
of  start  and  stop  of  the  test,  and  atatement  of  the  anvlron- 
rent  test  condition  level.  Other  pertihent  iuformatloa  may 
to  added  or  kept  on  secondary  documentation  as  desired. 


Under  the  heading  t!ie  Failed  Component  -Suanary  Analy¬ 
sis  form  should  be  divided  into  columns  in  acoordanca  with 
the  following: 


a.  Description  of  part  failed.  ' 
0.  Number  of  primary  failures. 

c.  Number  of  seeonda.7  failures. 

d.  Total- failures. 


The  width  of  the  first  eoluaui  should  Ne  wide  enough  to  eon* 
tain  description  of  the  failed  porta  such  as,  power  transfera- 
»r,  tube,  transistor,  capacitor-mica,’ capacitor-paper,  etc. 
The  second  and  third  columns  should  oe  wide  enough  to  con* 
tain  counting  marks  and  totaling  number  of  failed  parte  in  • 
either  category  for  the  parts  listed  in  c-olunn  one.  The 
last  eoltunn  will  contain  only  the  total  number,  the  sum  of 
columns  ( b)  and  ( c) .  .  . 


Beneath  the  column  headings  the  form  shall  be‘  ruled 
.'.orizontally  to  fjermit  one  line  t?  be  used  for  the  failure 
sam.-B.3r7  of  each  type  of  part.  One  mark  shall  be  made 
corresponding  to  each  part  failure  In  the  proper  cate-ory 
column. 


Upon  the  completion  of  each  form  as  atc'.*o  (for  one- 
equipment),  the  totals  therefrom  shall  be  transferred  to  a  ’ 
tctollilng  f-Jm  sJmilar  to  this  but  providing  total  contract 
(rstht-r  thar.  equipment'  part  failure  data.  Upon  completion 
or  ccntrnct,  «rid  any  previous  intervals,  as  may  be  speci¬ 
f-led  h-/  ths  contracting  agency,  the  final  or-  interim  to'.allted 
-art  failure  -.i-sta  may  te  I’oiwarded  to  the  cegnira'-'t  agency 
in  '■tter  and  table  tas  above}  fora.  liere,  of  course, 

'.--idjng  info-mat '-or.  pertinent  to  the  cc-.-.t  ract  would  be 
given. 


is-  cf  Forms 


Prior  tu  beginning  the  longevity  tejt,  but  after 
select icn  of  th-  eojipmsntr  to  be  te.tci.  h-adlng  tnforma- 
t;;r<  }3  to  be  inserted  on  the  Icc  of  .'^allures  form.  Opera- 
: :  -0  Clieet ,  and  E-iu  ir’-r.ent  Repair  S.oeett  I’.r.o  equipment 
r'-poir  sneet  for  e.c:,  - q-.,‘. -■«.-nt  to  !'•>  testedi.  ?ne 
■  1  ri ->'.1 1  Cl  t  y  f-.r  :  :  ;c'r*..arice  -  r.f' -rf  the  ec  iipe'c-t 
the  test  r  jst  re  ettabl  i  -a .  Be.'ir.n'.ip  with 
-nit  1  at {.rn  t-f  t'-'*  1 1. 3t .  t’ne  Cjeraii-.n  S.hret  Is  *0  be 
:  •  rtinnc  usiv  mair.t, -lined  'oricuri  ent-v  wiir.  Tne  SK.a-uremeri* 
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and  readings  taken.*  At  the  instance  of  the  first  obsenred 
failure  the  test  operator  auat  make  an' entry  in  the  Log  of 
Failures,  suitable  entry  oc  the  Operation  Sheet,  and 
Inltia'e  a  Failure  Report.  The  failed  equipment  should 
then  be  remoyed  fro®  teat,  without  disturbing  the  r«i«aining 
equi;:r;ents.  and  delivered  to  the  repair  activity  together 
with  the  partially  completed  Failure  Report.  During  and 
at  the  conclusion  cf  necessary  repairs  (nnd  ultimate 
verification  of  adequate  performance)  the  repair  porsot«nel*  ■  • 
must  make  applicable  entries  on  the  prevrLcusly  initiated 
Failure  Report,  must  Initiate  additional  Failure  Reporta 
for  additional  independent  failures  found,  if  any,  and 
»’ust  make  an  entry  in  the  appropriate  Equipment  Repair 
Sheet.  Thereupon,  the  equipment  ie  to  be  returned  to  the 
test.  Cpon  reinstallation  of  the  repaired  equiment  In  the 
test  facility,  the  test  operator  should  make  an  entry  in 
tne  Operation  Sheet  to  Indicate  satisfactory  operation. 

Cnee  each  day,  or  at  other  appropriate  intervals,  the  person 
in  charge  of  test  will  review  the  above  mentioned  sheets  for 
overall  accuracy,  proper  inclusion  and  correlation  of  data, 
etc.  Subsequent  to  the  agreed  determination  of  part  failure 
category,  he  shall  make  corresponding  entry  on  the  Failed 
Component  Summary. Anaiysi*  Sheet  for  that  equipment.  Sub- 
S'^quent  to  completion  of  test  for  a  particular  equipment, 
pass  or  fail,  ne  shall  transfer  the  part  failure  data  from 
the  equipment  sheet  to  the  totalising  sheet. 

!The  occasions  of  subsequent'  failures  are  to  be 
handled  in  identical  manner.  At  the  time  of  each  entry  by 
the  test  operator  in  the  Log  of  Failures,  he  should  cheek.  • 
to  d'^terelne  if  a  decision  to  pass  or  fail  the  tested  sample 
can  be  made,  or  If  the  test  must  continue.  At  such  time  as 
a  fail  decision  can  be  reached,  and  provided  that  equipment 
has  accumulated  a  test  operating  time  equal  to  or  greater 
than  tvclve  times  the  contract  specified  me an-tlne» between- 
failure,  the  test  on  that  equipment  can  be  discontinued. 

Such  equi.acents  as  are  ohen  deleted  from  tests  should  be 
referenced  to  the  repair  activity  in  order  that  the  appertain¬ 
ing'  Equlpcent  Repair  Sr.eets  may  be  closed  out  with  appropriate 
entry.  'All  other  equipments  operating  on  test  are  unaffected 
by  the  fail  to  pass  test  decision  for  a  specific  equipment 
except  for  resaitaat  decisions  affecting  the  lot;  l.e.,. 
upon  the  fail  to  pass  test  decision  for  a  specific  equipment,  ■ 
the  test  shall  continue  {with  a  newly  selected  equipment  re¬ 
placing  the  failed  equipment)  u.ntll  such  time  as  a  decision 
effecting  the  lot  is  ?nade. 

Subsequent  to  the  repair  of  equipment  failures  the 
repair  activity  should  forward  the  pertinent  failure  reports, 
together  vlth  the  failed  parts  or  components,  to  the  com¬ 
ponents  staff,  who  in  turn  will  re-forward  the  failure  • 
rervorts  to  the  design  group.  (In  the  absence  of  a  components 
staff  and  'or  design  group  the  reports  should  be  forwarded  to 
tre  o:rniiant  engineer;.  Ar.  the  Completion  of  the  test  all 
f'.rrs  tr'.  .id  be  reviewed  by  the  authorised  government  repre- 
jentatire  and  then  released  to  the  design  group. 

Rnlee  for  L-ata  Handling 

7'.e  following  rules  are  ma.  dato.-y  for  governing  the 
use  cf  ccllect.-d  data  and  t.-.f-  ror.nc-r  in  which  it  is  collected 
If  the  detlsic.”  reached  fr-'T  the  iingevlty  test  Is  to  ^ 


valid.  Tnasmueh  as  all  rules  are  subjeet  to  intarpretatioaj 
It  is  iHu  rided  that  the  most  .obvious  interpretation  shall 
apply,  ana  disputes  shall  .be  referred  to  the  authorised 
government  reoresentative  for. decision.  The  following  rules- 
are  applicable: 

1.  Inability  by  the  repair  activity  to  eonfim  the 
existence  of  equipment  failure  obaervud  during  test  shall 
be  Insufficient  grounds  for  deletion  of  such  claimed  failure 
In  the  count  of  total  failures.  It  is  Intended  only  that 
confimatlon  of  failure  by  the  repair  activity  will  permit 
better  assessment  of  needed  repairs  and  indication  of  any 
pofslble  fault  in  tha  testing  facility,  lack  of  failure  con¬ 
firmation  should  instigate  close  review  of  the  test  facility, 
and  if  the  latter  can  be  nbown  to  be  both  at  fault  ana  to 
completely  account  for  the  failure,  to  the  aatisfacticn  of 
the  authorized  government  representative,  then  and  only  .then 
can  the  count  of  such  failure  be  eliminated. 

2.  The  actual  failure  of  parts  or  compone.ita  can 
only  be  established  if  the  repair  activitjr  cam  unmistakably 
dunonstrate  that  suen  items  no  longer  meet  one  or  more 
specification  requirements.  The  existence  of  an  equip- 
aent  failure  under  conditions  where  no  part  or  component 
can  be  demonstrated,  to  be  beyond  specification  limits, 
must  be  classified  as  either  a  design  or  workmanship 
failure.  Ac  such,  it  shall  be  counted  In  the  tctal  number 
of  equipment  failures,  but  details  of  the  ciiuuastanees 
shall  be  deferred  for  close  study  to  the  design  or  quality 
control  activity,  as  the  caae  may  ba, 

3.  Determination  by  the  repair  activity  that 
more  than  one  item  in  a  failed  equipment  is  both  beyond 
specification  limits  and  wl’x  independently  prevent  satis¬ 
factory  equipment  performance  shall  occasion  the  repair  or 
replacement  of  each  such  Item.  Each  such  repaired  or  r#*r 
placed  part  or  component  shall  be  counted  as  a  separate 
equipment  failure  (although  the  several  were  observod 
simultaneously)  unless  it  can  be  demonstrated  beyevd  any 
question  or  doubt  that  the  failure  of  one  itsai  In  turn 
produced  the  failure  of  one  or  more  ©the.’ •  iterts.  If  such 
proof  can  be  demonstrated,  each  .depenaent  failure  may  be 
classified  as  a  secondary  failure,  and  as  such  is  not  to 

be  counted  In  the  failure  totals  of  other  than  the  Component 
foilure  ouiiir.iary  Analysis  eheet.  Adequate  proof,  necessary^ 
to  establish  the  secondary  aspect  of  certain  of  the  multiple 
failures  observed  simultaneously  will  be  at  the  discretion 
of  the  authorlzsd  government  representative.  At  lecSt  one 
primary  (aud  countable)  part  or  coaponeTit  failure  must 
t?ist  at  each  instance  of  equipment  repair  where  secondary 
faliurcs  are  claimed. 


U .  Ko 

any  equlijmcnt 
'•'rspccei-.t,  or 
tl.o-  tclerance 
tericratfd  for 
f  p>»c,5  f cat  Ion 
vertc-nt  replac 
AS  a  rrlmary  f 
of  the  a  it-hc-rl 


part,  compon-'nt,  or  item  may  be  replaced  in 
involved  in  test  unless  every  euch  part, 
item  can  be  prov.en  to  be  outside  of  speciri.'a* 
,  Such  jxirtc  or  ccmj'-cnents  as  have  ae- 
any  reason  bat  dc  not  fall  outside  of 
tclerances  cannop  be  replaced.  Each  inad- 
erent  under  such  cunc it: ons  ihall  be  cot'ted 
.'silure  ur.a  shall  be  called  to  the  stt en': ■-•■..o 
zed  government  rf presentative.  Vhen  a-n 


equlpiDL-nt  failur*  is  found  to  o<ci8C,  ana  no  part  or  eoa* 
por.s::t  can  be  provsi-  to  be  outside  of  specifl'atlon  llutts, 
then  the  equipment  .•.all  be  repaired  to  return  it  to  adequate, 
operating  condition,  and  the  specification  for  each  lie* 
repaired  or  replaced  shall  be  altered  sucn  as  to  reflect 
out-of-tolerance  condition  to  the  satisfaction  of  the 
autnorlzed  governmc  >:  representative.  The  fallurs  count 
for  s'ach  repaired  or  replaced  Items  shall  be  In  accordance 
with  rule  (3)  above. 

5.  Except  for  changes  mads  as  a  result  of  a  lot 
decision  no  preventive  maintenance  Is  allowable  during 
longevity  test  nor  during  actual  equipieent  repair.  (Re- 
acjustmcr.t  cf  operator  controls  Is  not  considered  preventive  , 
malntenan.'e.)  Anticipation  of  failure  shall  in  no  case  be 
j.istificatlon  for  any  preventive  maintenance. 

6.  All*  questions  and  disputes  arising  shall  be  ‘ 
referred  to  the  authorized  government  representative  for' 
decision. 

7.  In  initiating  the  test,’ the  randomly  chosen 
equipment  sample  shall  be  Installed  in  the  test  facility - 
and  operated  for  only  that  length  of  time  necessary  to- es¬ 
tablish  that  the  facility  is  working  properly,  and  that 
aiequato  facility  adjusiaents  and  calibrations  exist.  Up- 
to  this  point  acc'imulatei  equipment  operating  time  on  the 
ra.ndomly  chosen  equipment  dots  not  count  toward  the  test 
(and  similarly  any  equipment  failures  may  be  repaired  without 
failure  count).  When  the  equipment  iselected  for  longevity 
te.st  is  one  having  satisfacto»-ll>  completed  the  Reliability 
Index  Evaluation  It  shall  be  repaired  as  necessary, .nil 
previous  operating  tine  and  failure  data  shall  be  trans¬ 
ferred  to  the  longevity  te3t,.<'onn3  and  found  acceptable 
where  all  primary  failures  are  counted.  Thereafter,  the 
test  shall  begin,  and  all  operating  time  in  the  test  facility 
shall  be  counted.  If,  during  the  course  of  the  test,  fa¬ 
cility  difficulties  are  encountered  necessitating  equipment 
ope.ratlon  in  the  facility  for  experimental  purposes,  the 
tested  equipment{s)  shall  be  replaced  with  other  like 
equipment! 3)  not  under  test,  for  such  experiments!  period. 

8  It  shall  be  perml.ssib]e  for  the  repair  ace 
tlvjty  to  operate  any  equipr.ent  following  repairs  thereto 
for  any  desired  length  of  time  (prior,  to  resumption  of 
tc:t)  ?«<  "--ny  ssew  pcrlJi.ent  to  guarantee  that  the  true 
cause  of  equipment  failure  has  teen  established  and  ell*-' 
Inated.-  This  .shall  not  be  construed  to  grant  permission  for 
toe  repair  activity  to  inordlnttely  delay  returning  to  the 
test  sucft  equipment  or  e.'.ulpiuents  as  appear  to  have  ab-  • 
iK'.*roally  high  rates  of  failure. 

•  9.  Hequirements  for  action  on  data  taken  shall 
be  it)  accordance  with  the  instructions  enumerated  under 
the  heading  "'dse  of  Forms",  Lot  decls'ons,  however,  are 
denTlbed  under  Section  II. B.  2-e.  "Teat  Res;:lt3  and 
C.ficlusions"  are  discussod  with  ar.  a'.pilcatloa  examples 
•rider  feetton  IIl.B.i. 

10.  It  shall  bs  p-s’missitle  .'"or  the  contractor, 
prior  to  ih"  tf.tr  ,  tc  any  desired  debur.eir.g 

oj'-cr.-.tions  or  repairs,  on  any  sample  randomly  selected 
from  the  line. 


11.  Rules  sr»d  rrcsedur*?  for  needed  repair,  re- 
pi*e»r«f!t,‘ and/or  ctlitraticn  of  the  test  fecility,  to 
be  sade  durini:  the  test,  aust  be  entioipsted  and  es¬ 
tablished  subject  to  the  aprrcTsl  of  the  procuring 
agency ,  prior  to  iaitisf-on  of  the  test.  Additional 
niles"  needed  during  the  test  shall  be  cereloped' entirely 
at  the  discretion  «  the  authorised  goremsent  repre- 
sentativs. 

12.  Any  data  tscen  during  tue  test  which  require 
arbitration  and<or  resalutirn  oust  be  rescl^ed  inmedlataly 
follcving  the  data  occurrenots.  Ko  data  once  resolved 
xny  be  altered,  aithouch  adaitioral  clarifying  data  entry 
K.iv  later  be  made  In  orcer  to  asaist  In  je  consideration  ■ 
riven  by- the  authorised  rorenraent  rtpreseataclve. 

13.  In  the  case  of  a  lot  decision,  because  of 
failure  to  nass  test,  re-uiring .positive  action  consisting 
of  design  cfunpe,  =cdif i-stion,  or  rewerk  actually  related 
to  observed  failures,  all  equiptcents  on  test  must  undergo 
the  re-quired  action  prior  to  continuing  test.  It  shall 
not  be  perelssible  to  restart  test  with  new  (untested)  . 
but  properly  codified  equipesnts. 

lA..  When  equipments  und.jr  test  are  sfidified  aa 
In  pab3gr-aph  13,  above,  they  snail  not  be  rejected  as  • 
failed  on  Che  basis  cf  any  previous  data  but  only  after 
at  least  twelve  new  failures  havt-  pccurred,  as  if  a  new 
test  were  being  Initiated,  see  Section  II. 9.  2-c(3). 

15.  Rules  goverciBjt  ancicipatibie’  interruption 
to  te«.-  shall  be  established  rrjor  to  initiation  of 
test  inscfir  as  possih'*,  rn-t  once  established  should  be 
followed  except  by  perrission  ci  the  authorised  govern¬ 
ment  rearese-.tatire.  F-.'.*  exacple,  test  validity  is  not 
abridged  by  testing  cn  a  single  shift  basis  nor  by 
s''.tcrn!cticn  over  wees- sr.cs.  .Failed’ ecu ipcent  ren-ovals 
should  be  cade  so  as  to  ^tir.ltice  effect  cn  renn^nirig  • 
eoir-.raerts  (  r-itch  as  at  tr.e  arrrvprlate  tice  during  a  ’ 

..'.’cle  of  teffiperature  extreses J. 

e.  Test  Results  and  ’Ccr.clusloris 

f’-ring  the  ior.gerity  test,  whenever  a  decision  IS 
r«,i.-hfi  th.it  a  tested  ec-uttcent  has  wither  passed  or  failed 
the  test,  that  deelsior.  s-.s'.i  be  used  to  influence  a  general- 
decleion  for  the  entire  Irt.  A  lot  decisten  based  cn  the 
cocvlet  lor.  of  tost  o:  a  sir.glo  e-puip-ent  i?  statistically 
almost  re intng'.'0‘!s  is  ''>r  rrobst-lity  that  the  per¬ 

cent -'.go  of  ecu. cvjf.-its  in  t.-.e  lot  wnlch  wc’uld  yield  a. 
co-trar.f  liccision  is  H  an-i  bolcw  and  for  re- 

t-;als.  as  lot?  w.-uld  be  above  CH  as  would  be 

O-’l.-M  Vo  ena-.le  s  '.ot  oeci e'.cn  to  c.'fect  that 

th-C'  CX  St?  A  oo-f- of.".oe  tha*  lees  than  ©f  tne 

--/..ts  ’.n  f.e  ..'t  w.’,:  fall  a  loneev.ty  test  if  so-  test- 
t'.-,  r.f.’.:  0.:  ■  ..-..Ic  to  :e  teeiec  f'i  all  found  to  pass 

t'.?  tee'.  r.; ; .tr-^rt »  a-..*  t'eated  ar.d  all 

rass.  t:--:-.'  is  o.”  t'-.tt  the  r«rorrt&re  of  failing 

eo  : .  -  e.".  t  s  in  the  let  is  t;ar.  1''4. 


The  procureawnt  contract  shall  specify  the  number  of 
equipaenta  to  be  lonserlty  tested;  and  preference  shall  be 
driven  to  the  test  of  twelve  or  more  equipments.  Vhen  clr> 
cumscances  favor  the  test  of  fewer  than  twelve  equipments, 
the  number  specified  for  test  shall  not  be  less  than  two,'  and 
the  test  history  of  those  tested  shall  be  reviewed  by  both 
tne  contractor  and  the  contracting  agency  to  determine  from 
consideration  of  the  kinds  of  failures  observed  es  to  whether 
equipment  redesign  or  modification  should  be  required  for 
future  procurement  even  though  all  equipments  tested  ore  found 
to  satisfpctorily  pass  the  test.  The  contracting  agency  shall 
give  consideration  to  th  ■;  maximum  percentage  of  short  lived 
equipments  tolerable  eupply  and  maintenance,  expected  dura¬ 
tion  of  propcssd  longevity  tests  with  respect  to  procurement 
schedule  and  budget,  the  total  number  of  equipments  to  be 
(irocured,  thv  ccnUractor  test  facilities  available,  and  the 
destructive  ..ature  of  the  tests.. 


When  ’.he  contract  specifies  that  the  required  number  of 
equipments  to  be  longevity  tested  are- to  be  bested  in  2  or' more 
successive  groups,  tost  of  a  later  group  beginning  only  after 
'decision  on  an  earlier  group  tert,  then  if  ^1  the  equipments 
in  the  Initial  groi-p  fail  the  test,  equipment  redesign  or 
modification  approved  by  tne  procuring  agency  must  be  effected 
before  fiirthsr  test.  If  only  a  portion  of  the  initial  group 
fails,  or  if  any  equipments  in  later  groups  fail,  complete 
test  Jata'  shall  oe  reviewed  by  both  the  procuring  agency  and 
the  contractor,  and  a  decision  shall  be  made  to  either  (1) 
redesign  or  modify  tne  equipment,  (2)  require  longevity  test  . 
of  ah  increased  number  of  equipments,  or  (3)  lower  the 
longevity  raquiremants  specified  by  contract. 

Of  prime  !ni(ortance  to  the  contracting  agency  with 
respect  to  acceptable  equipment  are  those  data  In  the  Failed.  . 
Ooeponent  Summary  Analysis  «..d.jrflated  Failure  Logs.  Such 
data  provide  basic  Information  lor  the  most  economical  means 
for  establishing  Binimum  spare,  replacement,  and  repair 
parts  requirements  to  provide  for  the  necessary  and  subse¬ 
quent  operational  malritecance.  It  is  to  oe  noted  that 
this  tec^^llquo  for  factual  and.  economical  logistic  predic¬ 
tion  has  never  heretofore  been  practiced,  and  that  the  test 
herein  described  provides  an  ideal  means  both  practical  and. 
econonlca]ly  feasible.  •  ■ 


Of  prime  Importance  to  both  the  contractor  and  the 
contracting  agency  with  respect  to  unacceptable  equipment 
ere  those  data  enumerated  above  because  they . identify  ' 
Halted  life  characteristics  for  critical  parts,  components, 
and  material,  thur  indicating  specific  areas  for  redesign 
or  modification.  S'cch  .life'  data  will  usefully  contribute  to 
the  background  of  r.eliabllity  Infomation  on  parts  and 
materials,  of  great  benefit  to  future  endeavors. 


The  selection  of  equtpoent  seaples  for  test,  rsther 
than  being  made  randoaly,  is  always  aade  consecutively  with 
respect  to  the  sequence  of  equipment  availability  fro* 
production.  Thus  the  first  production  test  to. be  made  is 
made  upon  a  group  of  K  equipments  comprising  the  first  N 
equipments  to  become  available  from  production*  At  any 
later  time  if  a  test  is  required  either  on  the  basis  of  the 
requirement  for  testing  one  group  of  equlpcients  once  each 
month,  or  for  any  other  reason,  then  the  equipments  chosen 
for  the  test  will  be  the  desired  number  chosen  consecutively, 
from  those  not  already  shipped,  with  respect  to  earliest 
date  of  receipt  from  production.  . 

The  sampling  plan  requires  that  a  minimum  of  the  - 
first  22  equipments  produced  must  all  be  tested  and  found 
8atlsfacto:7  before  the  shipment  of  any  untested  equlprenta 
is  permitted.  For  such  contracte  as  procure  W  or. fewer 
equipments,  all  must  be  tested  prior  to  shi)»^t.  -The  de* 
tection  by  test  of  any  substandard  equipment  (low  KTBF)  IMS 
the  effect  of .immediately  halting  shipment' of  untested 
equipments  and  requiring  tliat  the  next  consecutive  j? 
equipments  must  be  tested  and  found  acceptable  before  resuming 
shipment  of  untested  equipments.  If  two  or  more  sub-standard.'  ' 
equirtoeots  are  detected  through  test,  shlp.ulng  of  untested 
equipments  having  been  halted  and  not  yet  resumed  because  of 
the  first  sub-stanoard  equipment  found,  then  the  50  consecu-. 
tive  equipments  must  be  found  acceptable  following  the  last 
substandard  equipment  before'  shipping  of  untested  equipments 
may  resume. 

.All  reliability  tests  of  equipment  samples  must  Ss  jMr- 
fofmed  upon  groups  of  equipments,  and  since  the  size  of  the 
group  together  with  the  contract  speclfied'f’  (minimum  KTBF)  de¬ 
termines  the  probable  length  of  test,  tf.o  slze'of  the  gruar*- ■>  . 
shall  bo  chosen  In  accordance  with  Figure  3.  The  graph'of  Figure 

3  relates  T,'.and  mouChly  production  rate,  to  both  the  number  of 
equipments  per  test  group  for  earliest  test  decision,  and  to 
prcbablu  length  of  time  for  test  of  that  group  si'ze.  The  initial 
production  test,  and  the  test  following  the  detection  (through  . 
tes'o)  of  any  substandard  equipment,  shall  always  be  performed 
upon  a  group  of  equipments  cf  size  chosen  from' Figure  3,  onter- 
Ing  the  graph  for  the  applicable  f  and  monfnly  production  rate. 
For  example,  if  f  were  100  hours,  and  monthly  production  rat* 

150  oquipoentf.  per  month,  the  size  of  the  test  group  would  be 
24  eq'jipments.  If  the  contract  f  were  again  100  hours,  but  the 
monthly  production  rate  were  only  2-  equipments  per  month,  the 
test  group  size  would  be  chosen  at  4,  the  mln.lmun  number  al¬ 
lowed  for  test,  rather  than  3  as  mignt  be  extrapolated  from  the 
graph.  However,  one  exception  to  the  foregoing  rule  for  size 
of  test  group  Is  permitted.  Following  detection  of  a  substand¬ 
ard  eq-cipnent,  the  t  't  grci:p  size  may  bo  Increased  by  the 
adciticn  of  any  n'u.mber  of  equipments  in  numerical  sequence  al¬ 
ready  on  hand  and  ot'nerwise  rea.'iy  for  rhi p-T.ent.  Additional 
sho.-tc.'; of  test  time  is  thereby  pcssJhie  when  available  test 
facilities  per.ult. 

For  such  procurement  as  5rec:ifies  values  for  f  and 
rcrthly  prci'uctlon  rate,  t  he  .in: srsact  ion  of  which  falls  within 
zr.«  sc  lid  zvJ.e  tc  the  rl.-b-  .r  ho'jrs  average  test  tine  and 

4  eq'Jinento  n-r  teit  frr-ip  cf  Flrure  ?,  then  shlp.eent  without 
test  cf  all  equipments  In  excess  cf  the  number  reoulred  for  a 


ruif  tar  -w*  u  wi. 


Bionthly  sample  test  Is  permitted,  provided  unacceptable  equ'p- 
aents  are  not  found  among  those  in  the  sample  tested.  Such 
shipment  of  untested  equlpaen'.s  Is  in  accordance  with  the  rules 
etated  above.  The  number  of  equipments  to  be  selected  for  tne 
■conthly  sample  test  shall  bs  as  specified  by  contract,  or  if 
not  spoclfied,  any  number  between  the  minitcua  number  found  on 
the  solid  line  portion  of  the  graph  of  Figure  3  for  the  con¬ 
tract  T  (which  is  that  number  requiring  an  expected  test  time  '• 
of  500  hours  end  independent. of  productions  rate),  and  the 
number  established  by  Figure  3  for  the  contract  1  and  the 
monthly  production  rate,  for  examalfej  in  the  absence  of 
specification  to  the  contrary.  If  T  is  100 
nouns,  and  the  monthly  production  rate  is  150  squipments, 
then  the  monthly  test  may  be  of  any  number  of  'equifatents 
between  4  and  2A.  If  f  instead  were  200  hours,  the  number 
could  be  chosen  between  6  and  33.  ' 

The  sequential  test  method  of  Jecticn  II. 11.1, 
which  Is  used  for  testing  the  equipment  sa.mples  chosen  In 
accordance  wit;,  the  foregoing,  permits  an  accencance  or 
rejection  decision  for  the  entire  group  under  test,  however, 
for  the  reliability  testing  of  production  equipment  it  is 
necessary  to  identify  within  a  test  group  following  a  re¬ 
jection  decision  Just  which  equipment  or  equipments' are 
substandard.  Such  identification  Is  made  in  the  following 
manner.  Following  a  rejection  deslslon,  the  group  shall 
be  cor.oinued  on  test  just  as  if  no  decision  had  yet  been 
reached.  However,  the  data  cn  the  group's  Log  of  Failures 
‘shall  be  analyzed  isaedlately.  The  failure  data  or.  each 
equipment  separately,  and  one  such  set  of  data  at- a 
chall  be  cansorea  from  the  group's  Log  of  Failures  to  de¬ 
termine  If  the  removal  of  any  one  equipreerit’s  feiiure  data 
(together  with  that  equipment's  accumulated  operating  time), 
will  prevent  the  rejection  decision  previously  reacl.ed. 

If  it  be  determined  chat  such  censorship  for  on#  or  more 
specific  equipments  indlvld  illy  does  in  fact  prevent  the  re¬ 
jection  decision,  then  such  tentatively  revised  remaining 
data  sh^l  be  scrutinized  to  determine  if  an  acceptance  de¬ 
cision  could  have  been  made  at  any  prior  time,  if  such 
acceptance  decision  is  possible  because  of  censorship  of  data 
fret  but  one  spoclflc  equipment,  then  that  specific  equipment 
shall  be  sat  aside  as  an  unsatisfactory  unit  and  the  remain¬ 
ing  equifrsents  released  for  delivery  without  further  test  as 
acceptable  units.  If  SvCr.  acceptan-ce  deciaio’i  Is  possible 
tacause  of  censorship  of  data  fr-cis  any  of  several  specific 
equipments  Indlvicually ,  tr.en  each  of  these  specific  equip¬ 
ments  shall  be  set  as:ce  as  unsatisfactory  units,  the  re- 
mai.nlng  group  released  rr?-s  further  test  as  satisfactory,  and 
t.'.e  record  altered  tc  note  the  presence  of  a  group 

:'a:  .ure .  If,  as  will  t«  mpre  co.’tr.on,  c«-'nscr3r7'j:**3T  cats  from 
r.e  or  several  specific  ec-iiosents  l.c-Jlvi dually  permits  oliaina- 
titn  o'"  tne  initial  rt  vcticn  decision  f-cr  t'ns  gr^-u?  but  does  net 
> et  per.mit  an  a'.ceptsnce  dc-cisicr.,  tnen  tiie  entire  group 
inducing  these  Identified  ecu ij -me fits  sr.all  o«.  continued  on 
t«st  'ir.i'.'i  the  r.t-.v.t  opne rtunity  ftr  either  an  iccept  or  re¬ 
dact  decision  taf.-o  on  c-t-tnineJ  data  less  one  censored  data 
s-t,  the  o'.-r.s.  red  oita  pet  being  an/  one  cf  those  data  sets 
vr  i.o.-.  prevent  the  oarj'.er  reject  decislcn.  If  tr.is  next 
ot'ortiifi.t/  dr  ie;ts;-on  .s  to  atcert,  then  the  equipiter.t 
res.onsthie  for  the  ce-c-scri’i  cate.  1.?  to  he  set  aside  as 
•ir..sat- ■•fa''ttry  .  a.cd  t"v  rerainuer  of  the  gr'ii:.  released  39 

If  cencors"  •  r  of  cat  a  I'rcm  .*-ore  rran  o.ce  ecviip- 
.T.er.t  "3ch  cermlts  o.-.ti  el  i-oinat .  on  i>f  tne  initial  reject 


monthly  production  rate 

m 
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dcclslcn  £»  wall  as  Justification  of  tha  latar  aecapt 
daetslon,'  then  each  such  responsible  e^tpnant  is  to  be  set 
aside  as  unsatisfactory,  tna  renalnder  released  as  satis¬ 
factory,  and  a  double  group  f.ilure  recorded.  If  the 
opportunity  for  next  decision  is  for  a  reject  decision, 
and  such  decision  cannot  be  prevented  by  the  selection  of 
any  ore  set  of  data  for  censorship  froK  those  sets  which  - 
will  prevent  the  earlier  decision,  then  a  double  group' 
failure  is  to  be  recorded,  and  slmultaneouj  censorship  of 
data  sets  froa  aore  than  one  equipoeat  Is  penaitted.  At 
the  time  of  initial  group  reject  decision,  if  it  is  found 
that  the  censorship  of  no  single  set  of  data  will  prevent 
the  reject  declsior,  then  slcultanecue  censorship  cf  susra 
than  one  set  of  data  is  pensltted,  and  a  double  group  failure 
is  to  be  recorded.  By  this  seane  detersination  shall  be  cade 
as  to  which  equlpoent's  or  squipcents*  data  to  withdraw  froa.- 
s  group  In  order  to  penelt  conclusion  of  test  with  accept 
decialon  based  on  the  uamAtx.irg  equipewnts  within  the  gioup. 
Deteruiiottb  ion  tnat  more  than  one  equipunt  within  the  group 
is  responsible  for  an  adverse  decision  shell  result  in  the , 
recording  of  a  double  group  failure  (even  though  the  un¬ 
satisfactory  equipaents  number  more  than  two).  Obviously 
following  c  double  group  failure,  shifaMnt  of  untested, 
equipments  may  only  resume  after  5U  coast cutlve  equipeientt 
are  tested  and  found  satisfactory. 

To  illustrate  the  operation  of  this  sampling  plan,  . 
Figure  4  has  been  prepared,  showing  a  variety  of  typical  and 
alternative  situations. 

b.  Environmental  Specification  and  Test 

Conoitions 

The  environmental  specification  and  test  conditions, 
for  tha  rol lability  Index  evaluation  of  production  equip¬ 
ments  is  Identical  to  the  cnvlrcnmcntsl  specific  l-lou  and  .  t 
test  conditions  for  the  reliability  Index  evaluation  of 
pilot  production  equipmerts,  a.nd  is  described  in  Section 
lI.B.l-b  herein. 

c.  Test  Procedure 

This  is  a  tectlng  proccOat*  -iKir.rd  ow  sequential 
analysis  to  determine  if,  under  specified  test  conditions, 
a  g,iven  group  cf  etul.pmerts  exhlhits  a  r.ean-tlae-b«tween- 
faiiurec  which  Is  equal  to  or  greater  than  a  specified 
minimum  value. 

(1)  The  group  of  equipments  for  reliability, 

Indsx  test  Is  to  be  selected  in  accoraacce  with  the  in¬ 
structions  given  ..  Section  Il.C.l-a,  Sample  Selection, 
herein. 

(2)  The  selected  eq-.'iprents  shall  be  fitted 
'with  elapsed  of-eratloiC  time  -teters  which  will  indicate 
the  total  h.-urs  of  test  time  accuaiuiated  by  the  equipment 
to  which  attached. 
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(3)  *  log  shall  be  set  up  Sor  use  during  the 
■  test  which  has  .columns  assigned  to  the  fcilowing; 

a.  Line  number 

b.  Ccnsecutive  number  of  failures  ob¬ 
served  and  identification  of  falling 
equipoant. 

c.  Revised  consecutive  failure  number 
after  data  censorship. 

d.  As  many  columns  as  there  are  equip- - 
ments  in  the  -group  under  test,  each 
Column  recording  accumulated  operating 
time  on  one  equipment  at  the  time  of 
failure  in  column  b. 

e.  Total  of  all  columns  under  item  d  "bove... 

f .  Revised  total  of  columns  under  item  d  shove ' 
after  one  or  more  of  these  columns  has  bsem 
censorsd. 

g.  Column  e  divided  by  contract  apecifled  XtBF,. 
Set  Table  3>  Kote  1. 

h.  Column  f  divided  by  contract  MTBP. 

(4)  The  test  shall  begin  only  after  the. 
equipments  to  be  tested  as  well  as  test  instnuacntstlon 
facilities  have  had  suitable  operational  check-out. 

(5)  The  test  is  to  be  terminated  lasedictely 
upon  a  dael8..on  to  accept  in  accordance  with  subsequent 
criteria.  The  test  is  not  to  be  teralnated  because  of  a 
decision  to  reject  in  accordance  with  subsequent  criteria,  . 
but  is  to  be  continued  as  outlined  in  Sertlcn  II  C-la, 
until  through  the  means  of  cenaorsh’p  of  the  data  from  one 
or  more  eqvlpments  a  decision  to  accept  is  reached  in  ac¬ 
cordance  with  subseruent  criteria. 

(6)  At  the  Instance  of  each  failure  a  log 
entry  is  to  be  side  on  a  single  line  with  observed  data 
for  each  of  the  columns  a isted  in  paragraph  (3-)  except,  • 
columns  c,  f,  and  h.  . 


(7)  Log  data  from  columns  b  and  g  (paragraph 
(3))  at  the  cqcpletior,  of  each  .set  of  entries  follcwlng 
an  c-bsei  ved  failure  are  to  be  'compared  with  ^atle  3  to 
d:tf  .-.■.ii'io  If  «  liccisinn  is -possi'Me '3S  to  whether  the  group 
ha.i  passed  or  failed  'he  test.  In  addition,  when  it  ■'s 
anticipated  t)at  the  cicu-rulated  operating  time,  in  the  ab¬ 
sence  of  a  simultaneous  failure,  has  reached  a  point  per¬ 
mitting  a  decision  ti  pass  the  test,  a  log  entry  may  be 
pMds  to  col  :ect 'such  operating  .time 'sr.c  terminate  the  teat. 
When  the  data  freo  cc.lumns  b  s.nd  g.  In  conjunction  with 
Table  3  In-Jicste  the  group  has  passed  the  test,  the  test 
Is  to  be  ter-'nated,  blien  such  dats  indicate  the  group 
her  failed  the  test,  th»  test  l.s  to  be  continued,  with  a 


run-nlng  ansl/tis  tc  determine  If  the  ceusorshlp  of  any  one 


l-uSin  under  l*."rr  d  {paragraph  •')))  dO'l  tne  reiatei  fail¬ 


ure  or  failures  ;n  c<vlt.an  b,  bon'n  ca-ncel  the  reject  decision 
and  ■.  ai'clt  an  ec-'.epo  icec.  olcn.  lolamns  c,  f,  and  h,  are 
tc  u.’id  fsr  t..ls  ar.alve's.  }'  .a  s^cor.i  reject  ceclalon 
Is  rcj.'.tcl  In  fli'.t»  of  !  •  •:..'6t  ■  (!vci?'.:.a.-'e:v-s  cei.s.rs.nlp 
c:  .1  d  e  ;ui:r.er.t  ,  the  •e*t  is  tc  be 

c  ,  .n;  t'’.<»r- ea*''. '-r  is  t"  eerier 

e:  '.tec.  •!  ;  r-  -  mt'.  ir.d 

a  to  accept 


f.iiy  tr.  r  re  •  -  rr.s 

jre-*  !.i  c, c,  uni  I', 
ti  .■*  -"t  j  rfic  e-. . 


,  -rjh  -KM  tM  %»  d*.  «*.  r.  r- 
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(i)  Oa  th«  eecaslon  of  a  fatlura,  th*  falla4 
a^aipMct  it  to  Vo  roaoTtd  and  rapatrod  without  iatarrup" 
tien  of  th#  tost  of  aa|aip>*Rii*  eontinaisg  to  utot  tott 
p«rfonuRCa  racaireeanta.  Upon  deeiaics  tnat  a  x***o«* 
asd  rapalred  ac'ulps*ot  hat  bean  ?^t\jrs#d  to  rapretantatlT#  • 
eparatloa  condition  it  thall  ba  ratunjed  to  taat  without 
latarruptioB  to  tha  aquipoanta  eontlnnlng  on  tast. 

(91  Tha  absanca  of  ona  or  Bcra  equl|)«anta 
for  tha  pMrpose  of  faJlur#  repair  shall  noc  rffact  tha 
ftbtlity  to  saka  dacisicna  fro*  log  data  and  Tab^o  J. 

(10)  Vher.  an  aoeapt  daeislen  la  aada  taeauaa 
of  acrutalated  operating  tlwa,  an  astro  is  tc  ba  nada  on 
a.iesarata  Itna  in  tha  Log  of  failuraa,  with  notation  In 
:olv.in  fb)  indicating  that  an  sccapt  zisLslcn  rather  than 
a  fallura  occurrenca.  has  oecasiocad  tha  log  entry. 

'  d.  Data  Handling 

Data  handling  for  tha  reliability  index  evaluation 
cf  produotion  aquisoent  is  to  ba  in  acccrdanca  with  that 
prescribed  lu  Seciluu  Il.S.l-d,  which  apcllaa  to  pilot 
.rroiurtloa,  except  that  th#  Log  of  ^ailur#a  is  to  ba  in 
accordance  wltn  the  description  given  is  Sectira  IIaC.l**o 
prevls'c#.  Atv  action  taken  in  acccraanca  with  rulaa 
set  forth  In  Section  II.3,l-d  (10)  shall  ba  unlforaly  ap¬ 
plied  to  every  equipaant  producad,  rather  than  only  to 
ttesa  chsaan  fer  test.  In  paregrapb  lI.E.l-d  (13)t  the 
aord#  ‘pilot  production'’  nay  ba  stricken  fron  tha  firit 
sest«oce. 


III.  PISCUSSIOi 


A.  Sasic  fieliabillty  Theory 

,  The  interest  herein  in  the  reile'rillty  of  alaotronle 
etnlpaent  lies  in-  Its  xeana  for  relating  failure-free  opem- 
t ir r.' pre h&biilty  with  the  use  conditions  that  are  expected 
tc  descrioe  a  glren  aisslon.  Rsliabllit.-  iS  defined- gan- 
eraiiy  as  follows;* 

Tha  reiiablilty  of  an  eculpcent  Is  tha 
protahlllty,  that  It  will  p^rfera  a  ra- 
qalrea  task  under  specified  ccnditlona 
Icr  a  reiul-'e'i  tarlod  of  tine. 

In  ccr.trsst  to  the  general  concept  of  reliability, 
t.-.«re  are  rellaotlity  considerations  ur.cer  specialized. 
United  cor.d Jtlcr.s.  Co*  of  these  of  conre-n  here  la 
Hel  ia.  i  lity.  Tnls  Is  defined  a*  fcilowas 

•The  lr.*-ersr.;  reliability  of  &n  eqalpaent 
la  tr.e  irooah'.llty  that  it  vtl*  deiivaf 
apsetited  -fortar.ce  failure 

arfer  tsst  t;:r.s  for  a 

reoctrei  p-sr.on  cf  tine. 


*h«  use  df  a  numerl>:al  valve  to  thla  probability 
p«ra5t9  quantitative  assessment  of  reliability.  The 
numerical  value  is  always  less  than  unity.  Q'lantltative 
future  prediction  >'*'  ♦‘sUurs-free  operation  during  con¬ 
templated  missions  can  only  be  based  on  careful  sna*!s- 
tleal  assessment  of  past  equipment  operation.  Deairabla 
values  close  to  unity  requite  larg»  quantities  of  care¬ 
fully  obtained  statistical  data.  In  general,  aost 
electronic  equipment  during  Its  useful  life  is  expected  to 
surviie  a  number  cf  failures  thiough  the  medium  of  repair. 
Obssrvatlon  oi'  tiia  frequency  or  rata  of  past  failuraa  dur¬ 
ing  operation  under  actual  or  simulated  conditl  ms  of 
expected  application  provides  the  moat  significantly'  useful 
data  item  for  future  failure  prediction  (i.e.,  reliability 
calculation).  In  order  to  employ  a  unit  of  measure  of 
this  observable  data  item  which  varlea  directly  wltb  (and 
cat!  be  easily  related  mathematically  to*  reliability  the 
reclprucal  o'*  failure  rate  has  been*  chosen  and  has  been 
termed  "mean-tlme-bstween-failures"  (MTBF)  determined  by 
averaging  statistical  quantities  of  data. 

Considerable  data  collected  in  recent  years  from 
many  elecironic  equipments  Jr.  eervics  use  have  adequately 
safabllshcd  the  fact  that  during  the  useful  life  (before 
waar-out;  of  electronic  equipment  those  with  the  highest 
obtains.. e  rellsM-llty  still  show  probability  of  occasionsl 
failure  and  such  failures  are  distributed  randomly  in  time, 
and  the  frequency  of  occurrences  is  independent  of  equip¬ 
ment  age.  Equipoent  uith  lower  rallabiilty  often  shows 
failure  occurrence  having  a  non-rand  )m  pf.ttcrn,  but  nearly 
always  such  fal.lure8  are  relatable  to  undesirable  ap¬ 
plication  or  conditjons  with  the  tquipoent,  and  could  be 
remedied  to  produce  the  random  failure  pattern  and  in¬ 
creased  equipment  reliability.  With  thla  consideration 
'  It  Sde**  proper  that  any  requireoients  for  eoulpmei.t  re- 
llabiiivy  (r'.jnaric.'iliy  expressed)  to  be  achlevsd  through 
de.tiigj,  development,  or  production,  be'  based  on  the  ex¬ 
clusion  cf  non-ran lorn  failure.  Such  requirement  nec- 
eseitates  that  the ■  ecul penent  manufacturer  either  eliminate 
th*  probability  cf  non-r  *  idom  fdliare  through  careful 
engineering,  cr  reduce  the  level  of  random  failures  to 
such  an  extent  that  'residual  non-raiido;^  failure  probability 
does  not  prevent  ochie’-enient  of  the  specified  reliability. 
In  fact  '*•  coi'li  be  shoMi  that  specifications  for  minlmuB 
acceptable  m ;;)n-ti’t:e-r.«twear.--'aih.r5S  (and  thus  minimum 
accep'o:-ble  r-llabiilty)  as  well  a.s  teats  based  upon  the 
existence  of  cn'.y  random  failures  will  gu8^8nt^'^•  the  de¬ 
sired  oq-ulf*:ic(it  i'sl  lability  even  though  ail  failures  are 
not  random,  and  that  the  cr.ly  effect  cf  the  presence  of, 
non-r'  dom  failures  is  aoditlorial  effort  required  by  the 
manuri-cturer  to  meet  the  rellnbillcy  sp-'clllcatlons. 

Ill  order  to  place  the  foreyrlng  discussion  in  the 
proper  per»rrctive  It  1  ;<  important  to  consider  the  overall 
equl.wtr.t  Jife,  figure  1  in  Gectlcn  T  s'nowa  such  a  life 
chai cterisr.' c  curve  as  previously  explalne-J.  Curing  the 
^n'Mal  lic;r.*!  cf  e 'lul i.Tont,  life  there  is  clten  found  a 
s).''rt  jerlon  t.f  t '.re  du.-lng  whicn  averaye  I'ai  -.5>-e  rate  lo 
Hot  cor..-* tar.t ,  liftvir.p  s.arte-  at  some  partii-tilir  value  and 
deorejssl  with  t'ae  unM.'  a  lov»r  and  reloti’oly  constant 
jf-Vf]  Is  r*».tobed.  Crrr  ;)  pnctlce  has  bran  to  Identify 
this  initial  period  of  decre*.* Ing  f**!'--.  *  rata  a*  the  earl/ 
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fa;i\jre  period  ("debugjtlnR  period"  or  bum-ir) .  Its  dura- 
sicn  and  the  slope  of  the  curve  are  peculiar  to  the  equip- 
Tent  design  end  the  monui'acturing  irethod  employed  Its 
oxlsteree  Is  attributable  to  the  presence  of  material  and 
parts  which  represent  "weak  slaters"  among  their  kind  and 
.-xperlence  abnonaally  short  life.  In  some  cases,  but  not 
all  these  parts  should  have  been  removed  by  Inspection 
r**Je?tion.  In  some  cases  the  defects  are  difficult  or 
Impossible  to  Identify  initially.  Common  examples  are: 

‘■jcI  of  corrosion,  strain,  structural  chenye  (crystalllsa- 
tii'M),  etc. 

I'eHowlnf,  the  early  failure  period  aoundly  de¬ 
signed  equipment  in  procer  application  should  snow  the 
tor, Tal  operating  period  evidenced  by  nearly  constant  fail¬ 
ure  rate,  as  previously  discussed.  During  this  period  the 
;!tlju«eo  occuzring  f.'.it  ittrJbutcc  tc  cither  of  two 
'.■.uses,  external  .Influences  or  internal  factors.  Under 
.'Aternal  influences  could  be  listed  vapariea  of  application' 
as  momentary  environmental  extremes  of  all  kinds,  but 
difficult  to  connect  wit'n  specific  failures.  Under  in-, 
ternal  factors  can  be  listed  residual  Inltia’.  defectives 
unrecognized  during  the  early  failure  .eriod,  aa  well  as 
Items  succumbing  to  early  wear-out  hut"  few  in  number  and 
So  distributed  as  to  p.roduce  failures  apparently  random  in 
time  of  occurrence. 


The  final  portion  of  the. life  characteristic  curve 
Is  termed  the  wear-out  period,  during  which  time  the  wear-out 
.if  /ariooe  items  occura  so  closely  related  in  time  as  to  make 
the  tine  dependence  of  the  failure  rate  significant  and  ob-.. 
sarvable.  Often  the  beginning  of  the  wear-out  period  is  in¬ 
dicated  by  the  beginning  of  failures  among  parts  haring  a  mean 
life  expestancy  short  compared  to  the  life  of  the  equipment 
before  obsoleacenoe  --  for  example,  electrical  brushes, 
bearings,  and  other  electro-mechanical  parts  or  mechanical 


parts,  or  electrolytic  capacitors,  batteries,  etc.  Wear-out 
faJluri.'S  c<.ntrlbutlng  to  are  most  frequently  associated 
v'ith  the  Consumption  cf  materials  through  mechanical  or 
■zhemical  action.  fTevcntlve  malnter.anno  procedure  per¬ 
mitting  t.'ie  rcplnceaent  of  such  items  before  actual 
failure  occurrence  is  often  sufficient  to  significantly 
■lefer  the  onset  of  the  wear-oxit  period,  at  least  insofar 
as  increaa’.ng  failure  rate  rather  ttnn  some  ether  criterion 
'■■i;ch  as  maintenance  costs  is  the  means  of  distinguishing 


w-ar-out . 


r.e: 

V 


■.„1 


By  assuming  it  is  proper  for  equipment  oanufac'- 
ers  to  op-rate  their  pro'^uct  sufl'lcl“ritly  prior  t.o 
ivery  to  carry  it  beyond  the  early  failure  period,  and 
■isc'.mjfir  tnat  separate  means  wi;l  be  employed  '.o  verify 
t  enu l,,.7ient  W'-'ar-cut  will  occur  -..niy  after  sifflcicnt 
•nai  operating  life,  it  is  pcssible  to  specify  desired 
lati.i'.y  index  cnly  in  t^rms  .of  the  failure  rate  (or 
"'•‘erabiy  the  .mean-tzme-i  r-tKep--fai  lures)  cliaracteristic 
■;ng  tne  cper.iiln.i?  perloo,  the  c'-ntral  dofDlnant 

r*  i  ;n  ,.'f  tf./'  li!"  c'i=  r'.ctertst)  c  curve.  Tne  level  of 
■  y.T'oF  curve  curinp;  tr.is  f-T 'od  is  cc .’.3 * o ered  to  be  a 
..'t:cn  of  thr-e  r.ijor  fa. are  vl)  long  time, 

:  rlr.cic-  q.iaii.y,  {.i)  e-..  . ncerinc  »■ '-crap:  i  yh.T.c-n t ,  (  3 ) 

»  envi ro:  menta ■;  cend; 1 1- ns ,  b' t:.  ihyslce'i  ar.d  perscr.nel. 
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Specified  reqwirefiencs  for  minimum  ecceptable  me*n-tlme- 
between-falluree  thus  are  athleved  by  factors  within  the 
control  of  the  contractor  in  the  case  of  the  first  two  of 
these  factors.  The  contractor  .ust  Insist  on  adequate 
.specifications  of  the  conditioii-  of  environment  in  order 
properly  to  achieve  them  under  the  conditions  of  the  re¬ 
liability  test  and  the  equipment  use. 

Tr>  -nriyce  the  time  distribution  of  failures,  it 
must  be  possible  to  tues'iure  Intervals  cf .  t Ime-oetween- 
fatlures.  Two  eirapllfylng  assumptions  are  helpful: 

Assumption  1;  Any  failure  occurs  at  a  discrete 
point  In  time. 

Assumption  2:  The  time  of  failure  occurrence  is 
tne  instant  of  initial  oetection 
of  the  failure. 

The  chance  or  random  manner  of  failure  distribu¬ 
tion  In  time  is  describabie  hy  a  Poisson  Process.  The 
Poisson  distribution  may  be  expressed  as  follows: 


where  Pj^  is  the  probability  of  n  failures  ocour.-ing  in 
tl;;.e,t,  .‘.iad  T  is  the  mer.n-o.cerating-tlnie-between- 
failures.v  • 

To  determine  the  probability  of  failure-free 
operation,  durir.?  a  given  time,  i.e.,  the  reliability  of 
the  oquii'ir.ent,  tee  expression  (l)  reduces  to; 


n  f  o;  Py 


(2) 


Hellaolli*y,  from  expression  ('i),  is 'a  funct.  on 
<.l'  t.ne  period  cf  time,  t,  tt.at  operation  is  re'.7.;lre(!  a.nd 
the  ne’an-oporati.nr-time-becwfcer -failures,  T.  This  relation 
;.i:  1'  The  re;uir‘-d  v^oernting  time  is  a 

variable  wnioh  oeper.ds  •;  J  the  speciiic  nii?s:'>n.  The  .mean-- 
jperat  ing-c.ir,e-n<  f  wee.’i-fa)  io-es ,  on  the  ut  her  hand  ,  is 
constant  .‘"or  equl;— lent  in  a  riven  environment,  and  is 

the  ba.<;ic  yarc.'ticx  used  for  rej.shillty  measurement  herein. 

Pir.jre  f  Uli.stroi'.es  rraihically  how  ro'arhabiy  the 
reilahilit/  iricr  of  an  eoutf'-ent  r.t-jel  .must  be  irproved 
in  relaUcr  to  t  r,e  riissi  n  length  in  truer  to  a'hieve  alpher 
rei  i  i  i  i  t  .<■;  in  •  r.e  rtgic.n  c;  15  tn,'<  y  iierc<''nt .  For  ex- 
av.pie,  il'  tne  eo.is.-.ent  T  is  increased  ir-'m  a  va’ue  equal 
to  the  rr.'.:  -;' n  ic-rgtn  to  ?.  value  ten  ti.T.e.'-,  at,  groat  as  tr.e 
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;,we-.-r.-;'6 1  lure.s  eisewr.ere  is  referred 
-te*. -t-er.- 'a;  1  ores,  iMTbr; .  dorre  spond- 
•  •'.M  r*'":;  r.*. jrs. 
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aisslon  length,  the  rellebility  (or  the  prctabillty  of  no 
failure)  increases  correspondingly  frca  373(  to  90%,  How- 
evet-,  to  achieve  a  reliability  of  99%  requires  an  equipment 
f  ICC  tlses  greater  than  the  nission  tise. 


The  aean-ttne-betwoen-failures  of  an  equipoent  B*y 
be  detersined  from  laboratory  test,  field  test,  or  field 
operational  data  and  may  be  computed  as  follows: 


where  tj  is  the  total  operating  tine  for 'each  equipment 
under  investigation  and  f  is  the  total  nacber  of  failures 


B.  Selection  of  Test  Methods 


1.  Pilot  Production  Reliability  Index  Evaluation 


The  testing  of  complex  electronic  equipments  in 
larger  numbers  and  for  relatively  longer  periods  of  tlms 
compared  to  present  practices,  will  inevitably  prsssht 
niujerous  new  problems  to  the- procurement  agencies  and 
the  manufacturers.  Some  increases  in  the  costs  of 
manjower,  facilities,  and  equipment  as  well  as  the 
time  .'*qi:ired  before  an  equlposnt  can  be  delivered' must 
be  exported. 


Let  it.  be  recognized,  however,  that  in  the  ab- 
ssnee  of  more  simple  means  of  determining  the  reliability 
of  the  procured  equipment,  testing  is  essential.  It  Is 
the  only  way  today  that  the  prccurement  agency  can  havs 
any  cerrea  of  assurance  that  equipment  tieets  specified 
reliability  requirements. 


The  Task  Group  considered  two  basic  approaches 
to  reiiaoility  tesfing.  One  was  the  determination. of 
the  equipment's  actual  mean-tlme-between-faiiures.  ThS 
other  was  the  determination  that  the  equirment  mean-' 
tlme-between-failures  was  equal  to  or  better. than  a 
specified  value  by  means  of  sequential  tos.t  teohniouea. 
In  the  latter  case  the  actual  value  for  the  equipment  is 
not  prlra.arily  determined.  As  the  pilot  rcliebllity  .test 
la  for  capability  only,  there  is  no  need  to  consider  lot 
sampling. 


Calculation  of  equipment  actual  aean-time-betwesn 
failures  la  frequently  made  where  the  observed  equipment 
Is  in  field  use,  its  operation  not  under  the  control  of 
the  calculator,  and  a  wealth  of  chronologically  recorded 
failure  in  forme  tio»*  is  available.  For  a  jre-set  con¬ 
fidence  and  precision  of  measuremer.t  it  is  «!»reiy  neces- 
oary  to  p.-ecess  the  required  number  of  date,  or  at  most 
await  the  acquisition  of  andltloiidi  data.  For  a  finite 
number  of  cquipt^r.tc  under  otoe.-vation.  tne  curaticn 
of  t're  observe"  ion  will  fce  CC'  '-1  tv  '.he  .tsan- 

ti.r.e-oet'<ean-rail-ure7  ir.uitipllod  by  ■ -.c  cuctl-nt  *f  the 
rec-uirec  r.'..Tber  of  rleoes  cf  >data  d.vided  by  the  r.u.ater 
of  e:u-p<rents  observed,  'fhuc  this  cbservation  i.fcrval 
can  -zr.lv  ~h  ae.vsured  In  terns  of  the  .'".es:;-tlst-'»*'w£3n- 
fallurej  yet  to  be  calculated,  and  thus  the  waiting  time 
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la  ur.kncm  fc**  achtdullzf  furpc-i.*ar"rcr  aftar-tne 
fact  reliability  calt  jilaiicjja’ aucft  crccefiare*  haw 
yielded  sound  oeasures  of  rsllability  cf  e^uipcert  lo 
the  Held  where  the  data  were  sore  cr  leas  unlimited 


In  the  case  at  hand,  auth 
productlt‘-i  will  be  witr.held  ce 
the  equlpaent  reliabllitr  Icdex  is  s; 

That  the  actual  reliacility  index  aay  be  hi^.er 
necessary  does  not  effect  auth.critaticE  fcr'procuc 
Its  main  effect  being  cr.  t.tt  seen 
ma*’ufacture,  plus  passible  legist 
oust  oner  for  other  artllcaticn 


After  investigaticn  it  was  cc 
duration  of  the  reliability 
for  scheduling  purposes  base 
fflean-tlme-between-failures  a: 
for  the  occurrence  -f  the  re 
for  the  desired  ccnflcetce  a: 

Test  results  froa  unaccectab 
a  calculated  mean-tine-b-stwe 
than  required  confidence  ani 
(bstause  of  the  ld.“f.er  nunbei 


uded  that  the 


:«  estimated 


cf  failures 


oh  'failf* 

t 

cbsein-ativ>n 

s 

the  .total 

s 

cbeduled  pe 
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Test  results  from  equircer.t  i 
required  would  yield  a  Icr.per  calculaccr  z^a: 
between-fallurec  then  tie  soecifitc  ninisua  and  there 
would  be  too  few  failure  ccsfct*vaticns  tuning  the- sene- 
duled  period  of  test  to  perett  the  desired  confidence 
and  precision  of  ireasurener.t.  However,  with  the  actual 
number  of  failure  ebser rat  ions  obtained,  the  precisioe 
of  (Tieasuiement  can  be  lowered  sufficiently  to  perait  cb 
raining  the  desired  hig.n  level  of  confidence,  and  it  wi 
be  found  that  the  lever  limit  of  the  ccnficence  intertfc 
is  no  lower  than  the  lever  Unit  obtained  froa  the  test 
of  r.n  equipment  wit.i  just  r.ne  nir.ir.xt  acceptaoie  aesr.- 
tlae-oetween-failures.  Thus  the  test  r-n  ic:  a 
preieterntined  length  :f  line  as  descriced  aoeve  is 
vaJld. 

The  next  co.-, si  derat  ion  was  to  deterri.ne  If 
there  was  any  possible  vay  to  sh.rten  the  ?co»duled 
len/’.th  of-test  without  the  confilence  in  th«' 

decision  to  acce.ct  or  reje-ct  th-»  roliabil.ty  Ivvel  of 
the -equi p-aent. .  A  stuiy  of  sequential  tcatir.f  tec.hnique 
showed  that  a  sequential  test  :o'-ld  te  cerfemed  wit.t 
.<?eiecte.i  confidence  level  to  -ceternir.e  if  tne  aesn- 
ti.ne-oetween-fallures  vsre  above  cr  bel-v  a  crsde.rrrin' 
value  {vit,,  the  specif. ei  value;.  Ter  a.c.t  a  test  the 
average  dur.ition  of  the  test  w„Ii  :e  astr-o.vitately 
3Ctv  cf  the  iuratic-r.  for  ro.^  r:rs  o.-rt*'.;  or  stancard 
evalurtti->r.  leohniques  rer.ttor.ei  .above.  ’-ioweveT,  on 
cce.ir’.-'-n,  circur.s;  i.nocs  w:;.!-,  re-.'..-e  a.n  extension  cf 
the  sequential  test  to  re.a:.-  a  leris-.  .n  a.-.i  t.ne  total 
iur.atirr.  then  .•tig.ht  te  e'Ce.tsive.  lareful  stucy  r.as  le 
t<.  .1  lerlElo:;  to  rec; -.-->.'.1  a  tr-x.oa‘et  .-erue..' -.’al  test- 
:.'’ig  otn  )Oi  f.ich  t:.at  t-e  t:xt~..-.  curst...''  ifcr  ;e:.:s-  -t 
!  -...ib.e  is  :o  "ore  r  i  o;  t.-.at  for  toe  sfa.'‘.3ori 

t-'cnr.’ :u*.  fhe  i;)cc-..'r:c  for  :e-'. s.;-.  a  ler.ct.'.v 
lest  1.'  r.-.f  r.crc  a  fv  •  :e“‘-..  t  -..“i  '  :;rf-.c*.rce 

of  ."esul;  t'  t  af'e."-  r  t  a' ;;  r.  T.'ere  is 
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•iElIirly  SOS*  (low)  likolihood  of  t  ver/  short  test  ' 
wit.-  c!iti«icn  reached  In  ^  of  that  duratictj  required 
Czr  tr.c  star.card  technique.  Thus  while  the  average  tiae 
fcr  t-'-e  crx-iciited  sequencjial  t»at  is  apprcxi-tately  }0% 
of  mat  rsqatred  lor  tr,e  standard  technique,  the  limit¬ 
ing  -.aluea  are  Si  and  tOi,  Discussions  cf  the. details 
c:'f.:is  test  sethod  are  contained  in  the  following 
section. 


2.  Pfcdjction  Reli  llity  Index  Evaluation 
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he  foregoing  Section  describes  the  finally  se- 
r.s  for  sufficiently  accurate,  expedient,  and 
determination  of  the  adequacy  cf  .VTSF,  with 
a  Contract  specified  lower  Unit,  for  equip- 
h  are  suocttted  to  a  specified  sequential  test. 

;d  evsry  prcdactlon  equlpsnent  were  subjected  to  . 
r.g  the  mission  of  the  Task  Croup  with  respect 
ion  equipment  would  ke  satisfied.  However,  two 
cne  of  basic  Importance,  and  the  other  cf 
iaccrtance  can  logically  be  raised,  and  solution 
clems  thus  cieated  has  led  to  extensive  further 
ica.  These  questions,  in  simple  fera  can  be 
;s; 


;1)  For  quantity  production  and  high  production 
rate,  is  there  not  means  to  test  but  a  sample  of  the  pro- 
citec.  « Mipments  and  yet  maintain  adequate  confidence  that 
ever>  ictested  eouipmeat  is  equally  satisfactory,  and  that 
t:.<  reliability  index  is  not  deteriorating  as  production 
crcceets;  ■  ' 


(2)  If  tests  are  conducted  on  grou.oed  equipmenti 
to  s'crten  the  te.'-'ting  time,  rather  than  on  equipments 
singly,  is  it  possible  to  oe  confident  that  che  presence 
cf  lertain  equipments  of  high  KTBF  within  the  group  will 
net  rask  p.ee.r.oe  cf  certain  other  equipments  of  un- 
satisf actmly  low  KTrF  within  the  group,  ana  if  a  group 
is  :h~.c  -.“.satisfactory  can  its  contents  be  ec?nowicaHy 
senee  1C  separate  satisfactory  fron- unsatisfacl 


'  iSc  question  (2)  althcutn  cf  secondary  impor- 
11  cf  pr-=ary  interest,  it  will  be  discussed 
y  of  me  s<»quentiai  test  xet.ncd  rrescrlbed  for 
tier,  testing  reveals  that  althcueh  the  se- 
t  op-erat-s  in  large  p-art  on  the  average  .MTBF 
the  ecuicment  group,  still  t.iis  type  ci‘  test 
sitt'-'e  tc  the  presence  of  e.:ui scent s  with 
w  values  of  >rrSf,  usid  this  is  in  part  oeaon- 
r.e  s-.crlsr  testing  tir.e  required  i'er  reject 
In  fett  it  IS  believed  pcs-sibls  t-o  s;.cw  that  the 
1  .'w  MTrr  «  :ui;r;e::ts  wit.-.i.';  a  croup  will  create 
-1  llity  cf  reject  decloitn  tbur.  t.'.e  probability  of 
Sion  tecsi.se  of  tnt  prese.nce  cf  nigh  XT5F  equip- 
1  o:  series  cf  data  fri-s  varltus  sxtendea  life 
.  f  it  h  rreue  of  equiprrer.ts  pr:o-t.ng  b  reject 
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trial  c*".".!- irship  cf  '.'.ta  sets  from  Ir- 
.  1^. 1  .<5,  o.ne  :et  a:  a  '■ic.e.  In  f.ict  a 
::.“.clusi  r..«  *>.0:  extend”!  life  test  cats  basi>d 
1.  ana. VMS  cf  t ns  tyre  etilcv*:  for  i:;e  illot 
;e;uer.t:ai  test  ar"  astcnis.nir.gly  ccns-istont 
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ABO  riecrous  in  aplt*  of  various  censorship  tsehnlques, 
and  confidence  Units  calculated  frcr!  a  posteriori  de» 
cislons  hra  consistent  and  realistic.  It  would  appear 
that  this  type  of  sequential  analysis  places  edae 
reliance  upon  extreme  value  theory.  Icccrdlngly,  Section 
II.C.l  has  been  prepared  based  upon  a  data  censorship 
method  for  culling  unsatisfactory  ecuipcents  from  a  re¬ 
jected  group  so  as  to  permit  the  group  remainder  to  be 
considered  satisfactory  with  a  minisun  of  additional  test¬ 
ing,  and  only  such  extension  of  testing  as  is  required 
to  maintain  the  Initial  confidence  Lt*  wits  segregation  la 
performed. 

Study  of  question  (1)  has  led  to  the  conclusion 
that  it  is  not  posaible  to  sample  sene  the  failures 
(from  the  equipments  on  test)  from  s.re  cf  the  equlpaents 
(from  the  production  lot)  to  yield  ccnclus lens  about  ail~ 
of  the  failures  in  all  cf  the  eoulrr.fr.:  s  without  getting 
Into  considerable  difficulty  v^lth  respect  to  assessment  of 
risk  or  establishment  of  true  confidence.  It  is  to  be  noted 
tnat  sampling  cf  failures  from  only  the  equipments  on  test 
constitute*  sampling  in  the  time  domain  cf  a  variable  which 
car  be  reasonably  aasumed  to  follow  ar.  exponential  distri¬ 
bution.  On  the  other  hand,  selecting  a  sample  of  equipmenta 
from  which  to  draw  conclusions  about  all  of  a  lot  of  equip¬ 
ments  involves  sampling  in  the  populatic.-:  domain,  end  the 
variable,  KTBF,  for  this  sampling  prccefa  certainly  does  not 
follow  an  exponential  distribution  in  the  population  domain,  . 
and  can  be  a8.aum«d  to  follow  a  gausslan  cistrltution  only 
by  hypothesis.  With  great  desire  to  sinialce  the  quantity 
of  data  required  from  the  population  dcnain  (in  order  to 
confine  test  requirements  to  practical  sagr.itude)  through 
optimum  choice  of  a  sampling  plan,  it  bss  been  disappoint¬ 
ing  to  find  that  a  sequent iul  analysis  by  variables  of  a  mean 
(KrBF)  against  a  lower  limit  with  unknewn  sigma. has  not  yet 
been  developed.  With  the  thought  that  suen  a  ssquential 
plan  might  possibly  be  developed,  and  n.'gh.t.ba  comblnable 
with  the  sequential  plan  already  chosen  fer  the  time  doaaia 
to  yield  a  streamlined  overall  test,  this  rreblea  has  been 
referred  to  consulting  statlstlclana,  &r.i  they  feel  that  in 
the  near  future  they  may  be  able  to  develop  such  a  novel 
plan . 

To  satisfy  requireicenta  In  the  Inssediate  instance, 
a  simple  attributes  sampling  plan  hu«s  ceen  chosen  for  popula¬ 
tion  sampling.  In  the  chosen  plan  each  equipment  within 
a  tost  group  which  passes  the  sequenslal  test  Is  judged 
good,  and  specific  equipments  are  separated  from  rejected 
test  grouns  and  are  Judged  bad,  so  that  t.te  re'.:3li:der  o*  the 
rejected  test  g.’xjup  can  be  judged  good.  Tr.us  of  all  equip¬ 
ment  tested  In  groups,  the  number  of  tad  eq-.jlpc-er-.s  are 
discernible  from  the  niscber  of  good  eqc.pr.er.ts.  Accordingly, 
at  a-cy  p.:iiit  In  production  testing  a  sarple  sire  n  for  an 
acceptanc-  number  c  {.number  of  bac  oqelpesr.ts;  can  oe  ea- 
tablisi.ed  such  th;*t  there  is  90it  cor.f '.oe:.c e  that  the 
ferc-.’itace  of  defective  equituterts  v '.e  as  bad  were 
tt-.jy  all  f-  be  terted)  does  not  exoori  UK".  Tnen,  with  the 
itnltin’  t  sampue  chosen  from  the  fin',  •r'.'ip.cehts  to 
ho  prodneeu  it  is  required  that  a  sa-cile  site  c;  n  for  c 
e'cual  tern  bo  tested  and  ail  found  f'x.  :e;crf  any  unteite-' 

<  1  ;.':e.'.t  s  are  f.rr.altted  to  be  releoret  fc."  selJvery.  If 

a  rad  equipment  Is  found  before  coterie: i-.c  test  of  kl 
eauipc.ents,  a  reouirement  Is  made  that  tr.'e  texv.  n  equipments 


v  ft- .  Jt.1  iw  t 


i-*w 


*ajic:riijwar«af*iCT^ 

tM-i  vr  _ _ _ 


,  ».Ai40**J4k 


all  b*  good',  Mhcr*  n  is  now  sslectsd  for  e  squal  ons,  befora 
untrsted  eqolpMBts  can  b«  delivered.  If  two  or  more  bad 
equipsenta  are  found,  then  the  following  r.  eq-alpments  must 
all  be  good,  where  n  Is  chosen  for  c  equal  two,  before 
untested  equipeests  can  be  delivered.  To  protect  against 
deterioration  of  JSTBF  as  production  progresses,  a  minimum 
sanple  is  required  for  test  each  month  so  long  as  no  bad 
equipments  are  found,  and  should  any  bed  equipment  be  found 
then' the  requi»-eeent  for  n  good  equipirenta  is  repeated 
prior  to  oellvetr  of  any  uctestei  equipment.  Values  of 
n  •  22  for  c  •  0;  n.  •  3*7  for  c  •  1;  and  n  •  50  for  e  »  2 
were  obtained  froat  graphs  of  the  incomplete  beta  function  ' 
fer  Iq  =  0.9  whidi  are  available  in  standard  reference 
sources.  Such  values  assure  90^  confidence  that  the  percent 
dex'faCtive  in  the  overall  pcpurlation  la  not  greatar  than  lOjt. 

The  ntiabcr  of  equipments  to  be  grouped  for  a  single 
test  is  established  on  the  basis  of  two  principles: 

for  ooe«-a-aonth  sample  tests,  the  number,  of  equlp- 
aents  in  a  test  group  shall  be  at  leant  sufficient  to  give 
average  expectation  of  a  rest  decision  in  500  hours  of  test 
operation  or  less,  a  testing  time  achievable  by  24-hour 
eperation  each  day,  five  days  per  week.  In  one  month's  time. 

Expected  test  time  in  houre  equals  20T/N  with  f. 

in  hours. 

To  meet  requirements  for  22  (or’ 37  or  50)  good 
equipments  to  estsblish  confidence,  group.  sisea.j9J)all  be 
chosen  to  give  earldast  test  results,  and  ,N  ■VTR/5  1» 
the  result  of  equating  w.^tting  time  for  equipment  arail- 
abi.Uty  {lo  terms  of  proa-jctlon  rate  R)  to  expected  average 
duration  of  test  {equal  to  2C?/S  hours  or  T/25fi  months  on  ' 
a' 500  hour  month  basis),  and  solving  for  that  value  of 
S  (in  terns  of  t  and  R)  which  gives  the  minimum  total 
elapsed  time  (waiting  tine  plus  expected  test  time). 

Earliest  test  results  art  eapnasised  so  that  sub-standard 
equiprent  say  be  sost  quickly  recognized  and  remedial 
action  Instituted. 
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3.  longevity  Evaloatlon  • 

It  becoxea  reasonable  to  expect  that  longevity  re¬ 
quirements  vili  net  be  as  u.-.lfcr.r.ly  included  in  every 
prccurenent  contract  as  reliability  index  requirements. 

Tna  extc.'.ucd  testing  tise  needed  tog^ether  with  the  des- 
truc-lvs  nature  cf  ior.gevlty  testing  an  become  slgnlfic-ant 
df terre.-.ts  for  small  lot,  shert  run,  repetitive  co.itracts 
wnere  t'.s  n'cflber  of  e.qulprer-.s  available  for  test  assign¬ 
ment  prevent  let  Ifcgevlty  .xon":’  ..ions  with  high  statis¬ 
tics!  C.1  cflden.ce,  •speclslly  if  longevity  is  already 
qualitatlvalj  known  for  t.-.s  ecuirment  type  from  earlier 
tesvfnq,  t-lcweyer,  is  the*  s  -.-i  been  no  previous  testing 
backf-rcuni  eu!lt  tr.7...nd  test  p:'ocedures  a»  herein  des- 
cr;'.—  !,  lc"p«v.'.;y  r» cjir-ne;.*.  s  sneui-j  bs  given  most  careful 
co.ns-.csrailcn  fur  --e  vast  nejerity  of  ail  procurement. 

Tc  rrrv.  ie  the  rre.-.-st  rrcbsc'l.ty  fer  favorable  considern- 
tlc.:,  t.n'.s  s*»:tn..  »..i  discuss  preferrod  means  for  do- 
te;-t:.ntn,-  new  i -.  'x^.';is=  t.-e  contracting  agency’s  options 
wit.n  r-.'t^ct  he  fa  riTsriCal  '.due  vf  the  iongfevity 
rcquirens.nt  to  ce  .'';e-:;f:ed,  inn  the  riumoer  of  equlpaento 
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to  b«  to  longevity  test.  Thus  an  optimum  balaaea 

may  be  obtained  between  the  confidence  level  of  test .con¬ 
clusions,  their  value  to  the  equlpnent  user,  and  the  tatting 
cost  In  time  and  dollars. 


The  preferred  numerical  longevity  requirement.  In 
terms  of  length  of  equipment  operating  life  before  MT3F 
degradation,  is  related  to  expected  equipment  calendar  life 
before  obsolc-scence,  and  the  operational  or  repeated  mission 
usage  rate' (hours  per  year).  Table  It  Is  an  estimate  of  ex¬ 
pected  operational  usage  in  hours  per  year  for  a  few 
categories  of  electronic  equipment,  which  may  be  used  as  a 
guide,  and  la  illustrative  of  the  rather  wide  variation 
that  may  be  found  among  electronic  equipment  in  geneial. 

In  arriving  at  s  niaterical  longevity  requirement j  available 
background  on  the  state-of-the-art  for  the  equipment  type 
being  considered  should  be  taken  Into  account. 


Decision  as  to  the  number  of  equipments  for  assign¬ 
ment  to  longevity  tests  must  take  into  account  the  re¬ 
lationship  between  the  statistical  confidence  in  quantitative 
lot  conclusions  fcr  the  number  of  equipments  tested,  and  tha 
expected  elapsed  tlce  duration  for  each  longevity  test. 

Table  5  is  a  convenient  conversion  .table  for  relating  the 
total  test  hours  available  as  a  function  of  various  working 
schedules.  While  it  will  be  oftan  considered  desirable  to 
require  that  longevity  testing  be  conducted  on  a  continuing 
basis  for  the  duration  of  the  contract,  later  produced 
equipments  being  put  cn  test  at  the  conclusion  of  tc*’*'  of 
earlier  equipment.  Table  5  may  be  used  to  determine.!' 
number  of  equipments  to  be  tested  simultaneously  so  that 
at  the  end  of  the  contract  a  .‘Sufficient  total  number  of 
equli'senrs  will  ha%'e  been  tested  to  provide  the  desired 
levol  of  confidence  for  a  lot  conclusion  as  Xo  longevity 
adequacy. 


As  in  reliability  index  evaluation,  two  confidence 
levels  (or  sets  of  risks)  function  simultaneously  in 
longevity  testing.  The  first  confidence  level  is’ associated 
with  tr.e  mesBurement  cf  KTBK  during  test  )n  order  to  determine 
that  KTBF  degradation  remains  tolerable.  In  essence  this 
1-  the  confidence  level  asso.ciated  with  the  conclusion 
reacnffi  on  es'ih  testco  equip, ■‘.eiit  as  to  whether  Ic  passed  or 
fail,.;  its  test.  Ir.e  testing  technique  prescribed  directs 
that  y.TSF  be  determined  by  a  p.rocedure  which,  in  effect, 
averages  twelve  consecutive  Intervals  between  failures. 

For  this  type  of  sartling  test,  wherein  a  single  variable 
(KTBF)  Is  under  surveiiiar.oe,  confidence  level  is  described 
in  terrs  of  the  .trco.ibllity  that  the  tested  equipment's 
true  H':b?  Is  contained  in  the  interval  described  by  the 
roorute.:  MT5K  value  .olus  or  minus  a  particular  to.lerancs 
is  p-rcent.  Vi.-.en  .HToF  is  computed  by  averaging  twelve  ob- 
.Srrved  consecutive  intervals  (between  f.'ii  lures)  the  following 
state.cent  a-s  to  ccrfidence  can  rad**:  The  te.'ited  equip¬ 
ment's  tn-e  .Mr??  will  lio  in  the  interval  shed  by. 

the  c — futed  .VTrF  :lus  cr  v-inus  Jf-  pvrcer.t,  nine  times  out 
cf  ten  ?or  wlt.n  r.-obat  1 1  Ity) .  Alth  ti.ls  confidence  level 
are  ass;cl--ite,i  certBii  values  for  {reducer's  and  user's  risk. 
As  .t  atf/ei  o.-.a  tire  ir.  tf-n  tl-e  irue  MTP-F  will  be  cut- 
."•Ice  of  toe  inter;  .1  cc? ou*  •*  1 ,  '  r.-re  is  up  to  ten  percent 
r.f--rce  'uee.'*,:  r'.if.  t  .at  'he  YT'rF  will  truly  be  too  lew 
even  tha  cal  ;u',at  lor  yiaiiio  a  value  s-i 'Tl el ent ly  hig.i 


to  Ju-tify  3  pass  dec. Sion  fir  the  test.  Ccnver'*"ly  there 
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* Estimated 

Equipment  Operating  Time 
Average  riours/Year 


Type 

Max. 

fwrtmi  u/^\ 

Min'. 

Airborne 

( carrier 

CAN 

1000 

700 

250 

k  Land 

War 

Eadar 

eoo 

500 

200 

based 

Elect. 

1200 

800 

■  300 

opera- 

“CHS 

4CS 

130 

ticnal) 

Peace 

Nadar 

500 

350 

100 

Elect . 

750 

500 

150 

Airborne 

Non-Opera- 

CAN 

2500 

1300 

LCO 

ticnal 

War 

P.adar 

2000 

1100 

.350 

(Adn.  k 

Li  *cc. 

2600 

1*)00 

592  - 

Trans- 

CduN 

IEU3 

3i5Z5 

w 

port) 

Peace 

Raoar 

1500 

750 

150 

■s» 

•Elect. 

2000 

1000 

200 

CAN 

L500 

3C0O 

2000 

War 

Radar 

5000 

'  AOOO 

3  ('tjT'- , 

Ships 

Elect. 

7C00 

5060 

CAN 

355^5 

Peace 

Radar 

3000 

2000 

1500 

Elect . 

tooo 

3000 

2000 

CA.k 

8500 

8000 

jcoc-  ■ 

War 

Had.ir 

8500 

8000 

5C00 

Static,' s 

C,  i.OC^  « 

3500 

8000 

6000 

■n*.' 

85'<0 

JCDO 

Peace 

•Radar 

6500 

8000 

30CO  • 

Elect. 

.8500 

.EOOC 

4000 

^Actual  Combat  Life  Expectancy  Ercluded. 


is  a  ten  percent  chance  (producer’s  risl:)  that  the  aquip- 
isent's  true  K7SF  1?  satisfactorily  high  even  though  the  • 
calcoiatioa  and  test  result  show  the  equlp.tent  to  have  failed 
the  test.  The  confiJerce  may  oe  Inpr^vc-d  and  the  risks  re¬ 
duced  by  averaging  acre  than  twelve  intervals  batvaen 
fallnr”?  in  T.pu*.  Ir.g  the  KT3?  for  test  decision.  In  the 
p.-eser.cc:  of  a  g/aoually  shrinking  yTTBF,  adding  earlier 
intervals  tends  to  raise  the  coBipute'i  M?B?,  while  adding 
•later  intervals  (er*.eiidlnr  the  test)  tends  to  lOwer  the 
corrjted  iiVBF.  Accor ilngly,  when  a  decision  based  on 
tweive  i.-.’nrvals  Is  In  disr-r.",  and  it  1-  datlrallc  to  re- 
.'('c.rute  the  iVTSK  hv  a-eraginst  more  *har.  twelve  consecutive 


■ntervala,  r.nlf  cf'thcse  to  oe  added  shcul  J  iatrerflately 
pr-:ece  the  oriisnal  twelve,  and  the  .-"naining  haif  shm, 
fcilcw  the  original  iveive  oy  extend.ng  the  test.  Tabit 
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TABLE  5 


«TiKe  Available  In  Terlous  Work  Periods  in  Hours 


Per.iod 

: 

1  day 

1  week 

1  month  2 

M>8,  3  mo5.  6  aoe 

5  day 
week; 

6  hr. day 

12  hr. day 
?.k  hr. day 

6 

12 

2L 

60 

60 

120 

168 

252 

506 

336  506  1,008 

506  756  1,512 

1C03  1512  3.026 

7  day 
week: 

"8  hr." lay 

12  nr. day 
2U  hr. day 

i 

12 

26 

56 

S6 

168 

^35 

LiO 

705  1068  2,115 
1610  2115  6.230 

• 

Period 

• 

9  *03. 

1  yr. 

2yr*v 

5  yre,  10-  yr». 

5  day 
week : 

8  hr. day 

12  hr. day 
2U  hr. day 

2 ',268 

27515" 

3,026 

6.0f.3 

6,068 

12.096 

l5|^  .  30J26O 
.  30,260  -  60.660 

7  day 
week: 

3  hr. day 

Ik  hr. day 
2U  hr.dav 

2,1*5 

6,365 

?,520” 

4.230 

3.660 

•  >,660 
8,660 
16.920 

16,100  28,3o(J 
21,150  62,300 
62.300  86.600 

*' Based  on  U.2  weeks  >  1  ocnth  (approx..  10  days  per  year 
allowed  for  vacations,  stc.) 


6a  gives  the  relationship  between  probability  or  confloence 
(risk  is  c-'.leu’ared  hy  subtracting  this  value  from  one) 
ar.d  precision  of  ■ceasnreser.t  (i.a. ,  the  r50Jt  associated  with 
averaclng  twelve).  It  should  he  noted  that  Section  ll.B. 

2-c  teriti nates  the  test  wr.en  ».ne  calculated  KTBF  falls  be-  - 
low  5'1>  of  the  value  3v«''ifi«i  by  contract,  this  JOjt  being 
chosen  to  T.ntch  the  y~‘\  precision  of  measureaant  associated 
with  9C'J(  confidence  ar.i  12  Iritev.al  averaging.  If  the 
tested  eculf.ff.e.ct' s  calculated  FTSF  by  cViance  exceeded  its 
true  WTsF  ty  Just  504  and  the  calculated  volua  just  equalled 
504  o.*’  the  ccr.tract  value,  then  the  true  value  would  be  only 
cf  the  contract  va.oe,  and  this  degradation  has  been 
jjcired  ao ;eptaole  for  the  procedure  shown  and  is  not  classi¬ 
fied  S3  !\  risk.  If  eit'teea  or  nineteen  intervals  were 
avorar"!  in.ateaj  of  prfe.ve,  tr.en  (from  Table  6a}  for  90jt 

the  precisio'.  c-f  seasurewent  is  and  the  true 
K"*  r'isslng  e-ulc''e:'t  could  only  be’  as  low  as  364  of 

t:.e  r-.-:r'ict  specifieu  value;  xorn  Importantly,  the  table 
ocows  l.'S'  tr.e  corif.-o^r.ce  ie  now  954  (54  risk  instead  of 
I'.tjC)  for  tre  origins-  5-4  precision  of  measureme.Tt. 
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SI 


1  Level  of 

*  dcX 

H 

m 

lilllHi 

43 

68 

97 

166 

20 

32 

45 

74 

'  12 

19 

2? 

U 

9 

13 

18 

31 

6 

8 

11 

IS 

4 

'  5 

6 

10 

*  Values  calculated  using  Student’s  "t*  Distribution 


Equle:i.ents 

Failing 


TABLE  6b 

90lt  Confidence  Level  for  Lot  Sampling 

Bsund'^rles  for  Lot  ?ercent  UnsatisfactozT* 
Equipraents  Tested 

_ 2 _ 6 _ 12 _ 22 _ JO _ 

3.5-5L^  1.5-^3,4  0.8-l65f;  0.k-9.>i  0.2-4.450 

2C-8C':i  .  9-4551  k-27%  2-165t  1-7. 4Jt  | 

17-60X  9-365t  5-2  Ijf  2-\0i  ' 
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Th«  second  ecnftdcne*  associated  with  longavltjr 
tasting  relates  to  general  decisions  concerning  ehtirt  lot 
acceptability  based  on  the  test  of  but  a  few  equifSMnto. 

Table  6b  relates  this  statistical'  confidence  level  to  tbo 
nuasber  of  equipemts  tested,  ?r.d  the  reletionshlp  for 
practical  purposes  Ray  be  considered  lndcpcr.dsr>b  ox  the 
size  of  the  total  lot  (thus  independent  of  the  number  of 
equlpuents  to  be  delivered  untested).  This  table  is  eotlr^ 
ly  based  upon  90%  confidence  or  probability  (and  thus  lO% 
user's  and  producer's  risk)  and  shows  the  upper  and  lower 
Units,  in  percent  of  unsatisfactory  esulpaents  in  the  total 
lot,  between  which  90%  probability  exists  as  to  the  true 
percentage  of  unsatisfactory  equi^ents  in  the  let,  all  as 
a  function  of  the  nueber  of  equipeents  tested,  and  tha  nun 
bar  of  these  found  to  fall  the  test.  Thu}  if  twalva  aqulp- 
nents  arc  tested  &cd  all  pass,  there  is  90((. probability 
that  there  are  at  least  0.85k  of  the  lot  which  would  fail 
the  test  and  at  worst  no  nOre  than  16%  which  would  fail 
tha  test.  If  in  a  test  of  50  equ.'pcients,  twe  fail  tbo 
test,  then  the  entire  lot  possessed  between  two  and  ten 
ccrcent  equipnents  which  would  fail  tha  test,  with  90f 
prcb-.bijicy  (or  In  nine  out  of  ten  such  occasion:i}.  If 
only  two  equipments  wero  tested  and  one  failed,  and  the 
entire  lot  were  rejected,  (froa  the  taoTe)  there  is  only 
one  chance  in  ten  that  fewer  than  20%  of  .the  cquipsi^to 
in. the  lot  would  be  bad. 

An  example  of  the  application  of  Tables  4 
and  6  to  a  hypothetical  anticipated  procureeeht  aay  Jest 
serve  to  illustrate  the  foregoing  considerations.  .Sipposo 
an  airborne  radar  i'>  to  be  procured  which  will  heve  xa 
KTBF  of  100  hours  or  more  (as  deterained  from  nissior.  re 
quirements).  The  initial  order  is  to  be  for  100  equipaenia 
with  deliveries  scheuuled  over  one  year.  Ko  longevity  back 
ground  exists  and  adequate  icnpevlty  is  considered  vital 
Obsolescence  consideration  estaclishes  that  the  war-time 
life  should  be  feu-  years,  Inspection  of  Table  4  reveals 
t.hat  operational  reouirc.xents  are  at  the  rate  of  800  hours 
per  year  or  }2C0  ho-irs  total  for  a  4-year  life.  T.ae  con 
tract  will  specify  3200  hours  as  siniaun  for  the  longevity 
test  (at  the  end  of  w.cich  the  KT3F  sh.all  not  have  dropped 
below  50  houri,  per  Section  II. B,  2-c] .  Allowing  for 
"on-eff  cycling  in  accordance  with  operational  use  and 
tha  conditions  for  test,  and  repair  tine,  a  total  test  time 
of  4000  hoars  is  anticipated.  Ouch  a  test  would  requlra  • 
two  years  based  cn  an  8-hour  day,  5-day  week,  from  Table  5 
■Mowever,  because  of  the  desire  for  e.arliest  l-ongevity  in 
foroatio-.  in  view  cf  the  ebsenco  of  past  longevity  data,  lb 
is  preferable  to  schccule  the  test  on  a  3  shift  24-hour  day 
day  week  basis  in  crcvr  to  co.f.plete  the  first  test  in  six 
.njr.ths  (also  free:  Ta'ole  5).  Ttes  two  such  tests  are  possi 
tie  with  in  the  or-»-ycar  dellvp.-y  schedule. 

A  ir  life  o.c  equiptent  with  Initially  mlnlanim 

acceptable  KTur  •'-tC  h'jrJ  wii.  priduca  an  average  of  )2 
f.-ii  lar.-s  if  r:o  :<T~F  d>’'rai'.t:cr.  ta.ces  place,  40  failures  if 
•otxir.  .r,  permia.sicls  defradatii.t  occurs  but  not  until  the 
vrr/  "'u  o.*  tr.e  t*-st,  anJ  fa:lu.-es  If  cor.tlnucus  strsight 
lire  icg-acsf.cr.  '.ccurs.  is  observation  it  can  be 

coniiuded  that  aver-.;ri-.r  of  rcre  than  twelve  failure  inter 
v.-,ls  f:r  r.iph«r  .cc:-.''.-;e.q'e  •"  tr-  fs:;  cr  tics  decision 
corcerntr.r.  csc’r.  *.oe*oi  equip'.v>r.t  is  not  practical  becauee 
the  average  weid  tr. .-ade  ever  too  great  a  portion  of 
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th«  U8«fttl  Ilir*.  Tf  the  •<)ii.tpn«nt  turn*  out  to  hav*  «a 
MTBF  wcXl.abov*  that  siniKua  aptciflad,  aueh  as  200  hours,  . 
such  that  an  avaraga  of  only  16  failures  will  be  obsarvad, 
it  nay  ba  noted  fron  Table  6a  that. the  averaging  of  the 
last  eight  failure  intervals,  if  found  to  yield  200  hours, 
still  gives  90!(  confidence  that  the  true  KT3F  is  above  60 
hours  (200  hours  minus  ?0<  of  200  hours},  and  any  rapid 
degradation  near  the  end  of  the  test  vould  automatically 
yield  more  failure  intervals  for  inclusion  in  the  average, 
thus  improving  tha  practsion  of  measurement. 

In  reaching  a  decision  as  to  the  number  of  equip<» 
ments  to. assign  to  longevity  test,  perusal-  of  Table  6b  , 
shows  that  to  hold- 90$  confidence  that  less  thsn  10$  of  the 
lot  (10$  of  100  equipments  equals  10  equipments] . Is  below 
longevity  requirement  necessitates  test  of  22  equipments  or 
22$  of  the  production  output.  Presuming  that  this  loss 
(and  cost}  of  production  output  may  not  be  justified,  .since' 
there  is  no  background  data  to  indicate  anticipated^ longevity 
trouble,  It  may  be  more  practical  to  consider  testing  no 
more  than  twelve  equipments,  in  two  successive  groups  of  six 
eecb.  If  all  six  in  the  first  group  pass  the  test.  It  can 
be  immediately  stated  that  there  is  90$  probability  that 
only  between  2  and  28  equipments  would  fail  the  test. 

Sim.lar  findings  on  the  second  group  reduce  the  probable 
number  of.  unsatisfactory  equipments,  and  even  If  one  ^ip> 
ment  is  found  to  fall  in  the  second  -group,  there  is  90$ 
probability  that  only  between  4,  and  27  equipments  would 
fail.  If  one  or  more  equipment’s  failed  in  the  first  group,  •. 
the  nusoer  to  be  tested  in  the  second  group  could  be  In¬ 
creased.  If  scrutiny  of  test  data  from  a  perfect  score 
first  grovp  Indicated  little  or  no  degradation  from  an  • 
initially  very  high.KTSF,  decision  might  be  made  o  Waive  • 
test  of  the  second  group.  Test  of  the  second  group,  besides, 
increasing  the  confidence  In  overall  test  results,  monitors  ' 
any  trend  between  early  production  and  later  production,  as 
well  as  evaluates  any  effect  from  the  multitude  of  minor 
design  changes  that  often  creep  into  production. 

If  procurement  ouantitles  and  production  schedul*  . 
ing  should  be  extended  for  two  years  more,  and  provided 
longevity  findings  were  excellent,  a  typical  cohtract  declalon 
might  be  tc  test  twe  more  equipments  from  the  second  lot' on 
an  e-hour  day,  5-day  week  basis,  taking  the  full  two-year 
period  as  a  means  for  meuitoring  the  longevity  realised  by 
the  initially  produced  units  from  the  second  lut.  Further 
test  of  prdviuus  passing  equipments  could  be  extended  to 
determine  just  where  the  onset  of  wear-out  would  take  place. 

Importantly,  the  failure  data  obtained  In  the 
longevity  test,  when  f-vlly  and  procerly  ahalyced,  yields 
much  useful 'information  as  previou.sly  discussed.  In  par¬ 
ticular,  the  non- ranooK  failures,  while  lowering  the.MTEF, 
indicate  design  and  production  weaknesses  which  may  b-» 
i.-t-mediateiy  rectified  by  either  applying  improved  design 
te'-ihrilque  or  prescribing  ruitlr.e  maintenance  schedules 
and  prccedui-es.  The  choice  will  be  iSadtj  or  at  least  in¬ 
fluenced,  by  the  contracting  arer.cy  through  censideratien 
of  the  time  and  rogularitv  of  occurrence  cf  the  non-rrndom 
failures.  All  such  cata  ani  roi-cted  information  is  vital 
1.0  the  national  defense  in  orcer  to  cbiai.n  continuing  re- 
lia'cllicy  'ey  means  of  general  application  of  such  kncwledge 


to  all  rolatfd  aiailar'daralopsenta.  Alao,  by 

proTldinf  for  rvoatual  corralatioa  of  fiald  and  faeterr. 
failure  rate  daffa,  through  faed^haek  aeana,  sueh  corralatioa. 
will  guarantaa  that  futura  production  reliability  will  ba  .  '  . 

aalRtalned  throughout  tha  operational  application  period* 

C*  Katheaatleal  Xalatlona  - 

1.  Pilot  Production  Reliability  Index  Evaluation 

The  reliability  test  requireaent  for  pilot  .produc-  ' 

tion  equipment  is  for  the  aeasurement  of  capability  OKly* 

This  Is  interpreted  to  naan  tha  determination  that  tha  . 
mean-tiec'between-fallures  averaged  for  the  apaciflad  ; 

sample  (between  2  and  10  equipments)*  equals  or  exceeds  '  , 

the  required  ecntracC  specified  ainlsus  oean-time-between-  ..  -  4;] 
failures.  These  testa  do  not' provide  a  brsls  for  drawing  ‘ 
any  reliability  conclusions  Concerning  tha  remainder,  of  ’ll 

the  pilot  production  lot  (if  any)'. 

.  ‘ 

Prediction  of  what  the  mean-.tine-between-falluyaa  i-.  Va" 
for  any  equipment  will  be  during  future  operation  rtquiraa  .. 
trial  operation  of  the  equipment  for  a  long  ehou^'.'.tliBa.  o  ^ 
intenrai  to  observe  the  times  of  occurrence -of  a  sui-  , -jj 

ficier.t  nusber  of  actual  failures  to  permit  statistical  ,  '  . 

assessment  with  .leaired  eonfiesnee.  Thus  a  sample  of  tlnea-j.v  i.  J'l.'.'jj. 
between  failure  occurrencea  is  taken  from  which  .ia  computed'-pS;,?:*- 
a  naan,  which  is  la  turn  assessed,  for  its  validity  in.  ra».  •'>;  rj'.' ,;:f,  'C 
lation  to  its  repsesentation  of  the  value  during  normal 
operational  use*  This  saapllng- problem  (in  tha  time  domain- 
rather  than  in  the  more  customary  population  doeain)  is  nptly-;.. 
suited  to  solution  by  a  special  type,  of  sequential  analyaia 
I  sequential  life  tests  in  the  exponential  case'*')  . 

Best  known  sampling  plans  assess  a  product  by  at«  ' 
tributes  (criteria  each  of  which  evaluate  the  product  only 
in  teres  of  good  or  bad)  and  such  plans  have  an  advantage'  -:J 

-in  that  cany  different  .kinds  of  attributes  can  be  asassaed 
simultaneously  in  the  same  sampling  .operation.  .  Less  regu» 
larly  are  sasplinx  plans  which  assess  a  product  in  .'' 

.terms  of  variables  (criteria  each  of  which  la  a  continuously 
varying  paraaeter  upon  which  are  imposed  llmita  or  toleraneaa'-’.::co^t'-V 
of  asoeptabillty)  and  variables  sampling  plana  do:  not  con- 
veniently  consider  several  variables  criteria  simultaneously,^;,,  t..  ’ 
the  sanding  ealculation  being  repeated  Instead  for  each  '-■'Ij.i'.- - 
variable.  However,  where  there  la  but  a  single  criterion  ; a  ;  '  V 
(the  case  at  band),  a  variables  sampling  plan  has  the  ad-  •  v  "  P 
vantage  of  requiring  less  data  thin  an  autrifautea  aampling 
plan.  • 

Product  acceptability,  as  judged  by  a  sampling 
plan  is  commonly  eetabllshed  by  statistically  estimating 
the  fraction  of  the  total  lot  which  is  defective,  and  in 
a  varl3bl»s  plan  s-’  designed,  the  average  value  of  the 
variable  ard  its  dispersion  are  used  in  a  calculated  esti-  "■ 

cate  of  tne  fraction  of  the-  lot  for  which  the  variable  is  ■ 
outside  of  acceptable  tolerance  limits.  In  statistical 


'•'■Seque.''.ti3l  Life  Tests  is  -.he  Exponential  Case",  by 
a.  L;?'.eir*  ar.=  Ji.  5--'oei,  Annals  of  Kathematical  Sta¬ 
tistics,  M-ar  1955,  pp  S2-9'}. 
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ftsatssaimt*  of  •  aot  ptrforat^  to  •otablioh  «£• 

CpptabllitTi  tut  rttior  f*!*  inforMtle*  oaly  (and  that 
under  eondlticne  a(^<r«  there  at*  no  apeclfied  toleraae* 
llnlta  for  aece«:a;llitr  for  tne  variable)  It  la  euatooary 
tc  describe  In  tensa  ef  arbltrertly  chosen 

liaita  of  the  varis'cle  often-  terecd  eoofideaee  interval  or 
precision  of  sjess'-reoent ,  and  to  state  the  probability 
that  the  variable  is  vithln  these  Halts  (ehieh  is  the 
save  as  sayln^c  vrhat.  fraction  of  the  let  ess  be  expec  ed  to 
He  outside  of  this  interval).  As  an  exaaple  it  eigi.t  be 
stated  that  i,ue  Kiein>tii9e«between>failurc8  oas  eatiaated 
to  be  100  hours  vitn  9^  confidence  and  ♦  20Jt  precision 
of  neasurenent.  Tiis  is  interpreted  to  oean  that  90%  ef 
the  tine  the  variable's  xean  Is  between  tO  and  120  hours, 
or  if  80  and  120  nc-ers  were  considered  lower  end  upper 
Unite,  then  lOi  fraction  defective  will- exist.  In  ths 
case  at  hand  it  is  sere  direct  to  dcteralnt  aeeepvsbility 
in  terns  of  a  sinple  Halt  to  answer  the  dueation.  "what 
percent  of  the  ti^  will  the  aean>tia*>bettMett>faiiures  . 
exceed,  say,  80  hc-ers?"  For .centractins  purposea  thlt  . 
question  Is  convened  to  the  denand,  "Sstabll^  that  90%  ' 
of  the  time  the  niean>tisc<>b$tween-failurea,exeeeda  a 
particular  contract  value,  f." 

The  eesuestial  saapling  plas' chosen  baa  tha  advan¬ 
tage  that  it  ca  escablish  coapllancc  with  pueh  a  eon-  ■ 
traetual  requirazen  very  quickly  for  equipaent  whoa*' 
neari-tlne-betweeofall-srea  greatly  exeeeda  the  required 
miniBum.  In  fact  ti-e  cost  of  the  test  will  vary  In  ore- 
portion  to  the  cleseness.witb  which  the  equlpaent'S  T 
epproaches  the  reccired  T.  6y  truncating,  as  will  bs. 
described,  the  sercsntUl  test  will  always  be  aore 
econoBleal  than  kcf  ether  statistical  type  ef-aaaeaa-' 

Eient. 

In  statlctlcal  assessnent  there  are  only  two  rlaks 
bresont.  The  first  Mek  Is  that  good  equlpcent -will  be 
•considered  bad  ( p»r:'8r«-vr* s  risk).  The  secoaJ  risk  is  that 
bad  equipment  will  be  considsred  good  {consumer* a  riskK. 

The  second  risk  has  c«-a  already  stated  in  the  preceding  . 
paragraph,  though  in  different  -words,  to  the  effect  that 
since  there  need  be'  ccly  90t  certalnty-{$0)(  of.' the  tlae) 
th!,t  tha  required  T  is  exceeded,  there  is  willingness-  to  . 
consider  trM»  T  is  alvars  exceeded  men  in  reality  10% 
of  the  time  it  nay  not  be.  The  first  risk  can  be  thoui^t’ 
of  in  regards  tc  how  long  shall  the  test  continue  when 
the  equipment  7  is  sc  marginal  that  s  -wrong  deeision  (bad. 
when  really  goed)  sJ..-nt  be  oade-frv*  c  short  teat.  In. 
order  to  hold  accett*:!?-  lew  first  risk,  (to  satisfy  the 
producer),  ana. yet  retain  test  eeonccy,  certain  empirical 
lifflltationa  have. beet  established. 

It  has  been  decided  to  requi;-*  by  contract  -that 
the  miniauie  accertsrie  xe?**-tlB:t-beiwe-s-f allures,  Tj, 
will  be  5C^.,greater  ttir  act-aally  desired  as  a  Binlaua. 

This  value  Xj^,  spelled  c-ct  in  tha  contract,  le  associated 
with  a  first  risk,  cf  ,  cf.iC^f,  to  establish  by  the  saapllng 
plan  recommended  ti.^t  is  cnir  a  IC??  chance  of  reject¬ 

ing  (as  bad)  ec-jirrett  wttA  Beets  (or  exceeds)  this  figure. 
The  plan  actually  rsc'.ily  reduces  the  risk  below  lOi  In 
prcjiortion  to  tr.e  eveert  that  the  ec-ciprer.t  ?  exceeds  Tj. 

Tl.e  plan  is  des jcr.e;  -.c  allow  only  i0»  second  risk  i,?  ) 
that  the  plan  wt.l  sccert  <_a3  good)  equtcaent  whose  T 


•qual*  OP  fallo  below  Tj*  To  —  tho  xelw*  setwolljr  po« 
quired  as  a  alnimua  la  equal  to  2/3  Ti»  and  is  not 
Ideecifled  in  contractual  remiraments.  In  effect  this 
■eans  ttat  squlpoents  whose  f  falls  betwem  fo  and  t}  can 
be  either  rejected  or  accepted  la  aeeoriaace  with  ehaaes ' 
operation  of  the  test  without  eoncsra  to  either  the  pro*, 
duecr  or  consuRer.  Under  this  arrangeneat  it  is  possible 
bo  Bake  certain  stateaents  concerning  the  expected  uagnl* 
tude  of  tho  sequential  test  which  will  pemlt  testing 
tiae  to  be  scheduled  even  thou^  in  a  sequential  tert  the 
testing  time  required  ie  a  variable  and  deprade  upon 
Intemedlate  teat  resulta* 

With  the  aequentiel  sampling  plan  reeoiaiended 
for  pilot  production,  the  following  condltione  will.pre* 
vail; 

( a)  If  the  actual  f  of.  the  eqalpnent  la  «(}ual 

to  (contract  value),  the  average  teat  dttration^.wilI.,>e 
2Q'Tx/N  hours,  where  N  is  ths  number  of  eq^pmssts.  oh.;'; 
test.  If  T  is  sicnificantlf  greater  them  T}.,  the  average. ^ 
test  durstion  will  be  less  than  thi.s  figure  and  will  ap*  ' 
proach  as  a- limit  4  fi/N  bourse  .  ■ 

s'*'  ^ 

(b)  If  the  actual  f  ie  eq>ial  to  equal 

to  iy),  the  average  test  duration  will  be.  15  T}/d^ hours. 

If  ?  Is  significantly  less  than  2/3  ¥x*  ^ha  average  taai 
duration  win  be  less  than  this  figure.aad  will  approach  ; 
0  hours.  ■  -  * 

(c)  If  the.aetusl  f  is  approxiaateiiy  b.di^fv 
(midway  hetwssn  fx  and  To),  the  average  test .durstigh  will 
be  19  Tx/N  hours  to  reach  a  reject  dscisioa  and  2S  Tx/M.  . 
hours  to  reach  an  accept  decision. 

The  table  establishing  sequential  test  erltsrls 
for  accept  and  reject  decisions  has  been  calculated  from  ' 
two  equations: - 

1*  •  o.ai  Tf  -  4'.4  -.V  • 

•  T  -  O.dl  f,  ♦  4.4  ' 

where  Yf  *  .  number  of  failures  to  permit  a 
reject  decision  in  noAMllted 
time  T,  and 

F.  ■  maxiaum  allowable  number,  of 
failures  in  homalised  time  t 
which  permits  an  accept  de¬ 
cision. 

T  cgn  be  converte'i  to  real  tine  by  nultlplylog  Its  value 
by  T^/N  where  Tj  Is  the  contract  specified  value  in  hours 

.and  W  Is  the  number  of  equipments  on  simultaneous  test.  . 
Phase  two  equations. are  derived  in  sceorCance  with  the 
sequential  analysis  theory  set  forth  In  the  following 
paragraphs. 

In  Section  I.TI-A  the  Poisson  distribution, 
wplch  favors  the  most  acceptcble  equipment,  states 
that  the  probability  P„  of  n  failu.-es  occurring  la  time 
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t  If  f  ill  tht  tru* 

!•  glf*a  W  a  .  ’  . 

(I)--'"  ■ 


Bf 


(1) 


When  an  eiiultaent  eenple  haa.  been  in  operatiea  far  a 
particular  time  interval  t,  and  a  certain  nuaber  of  fail¬ 
ures  n'have  taken  place,  this  equation  (1)  Jhoold  show 
the  highest  value  if  the  correct  and  true  valaa  of  t 
for  the  equipaent  in  question  la  inserred  in  tba  foraula, 
and  should  yield  lower  values  of  P-  for  values  of  T  either 
significantly  higher  or  slciilflcantly  lower  than  the  true  ' 
value.-  In  fact,  equation  (1)  can  be  applied  first 
its  T  equal  to  T2  (that  value  for  which  a  reject  daciaioa  . 
should  be  made)  and  the  probability  calculacad.  Xaxt,  a 
second  caleulatloii  can  be  made  with  T  equal  to  Ty  (that 
value  for  which  an  accept  decision  should  be  Mde)  and  the 
probability  again  calculated.  If.  from  the  firat  calcula¬ 
tion  the  probability  that-  the  equlpnent  f  ia  T2  is  foudd 
to  bs  much  ,^reater  than  (he  second  calculated,  probability 
(that  the  equipment  T  is  Ti)  it  is.  likely  that  th'a  equip¬ 
ment  should  be  rejected,  if  the  second  probability  is  much 
greater  than  the  first,  perhaps  the  equipment  should  bs 
accepted.  The  problem  now  is  to  decide  limits  for  thess 
ratios  of  these  two  probabilities  that  art  consistent  with 
the  two  risks «  and, a  previously  described,  sc  that  which-  . 
ever  decision  is  made,  it  will  not  violate  the  prehsalgned 
risks.  When  such  relaticnshlp  is  established  for  the 
probability  ratio  with  respect  to  sc  and  .  tbeia  a  test 
may  be  begun,  and  at  thd  time  of  each  successive  failure 
the  probability  ratio  can  be  calculated  (using  the -ob¬ 
served  values  for.  n  and  t)  and  a  decision  made  at  the 
f.rst  opportunity  which -will  not  violate  cc  orjt  . 


Equation  (1)  when  rewritten  with  T  equal  to  f? 
for  the  numerator  of  the  ratio  equation,  and  then  ra>. 
written  with  ?  equal  to  7.  for  the  denominator  of  the 
ratio  equation,  and-  with  neual  algebraic  cancellation  . 
appears  as: 


I’r  * 


n  2 


or  further  simplified 


Epstein  and  Sobel  have  shown  a  good  approximation 
of  limiting  values  for  this  ratio  in  simple  terse  ofot  and 
0  which  permit  decision  without  violation  of  the  prescribed 
risks.  In  simple  terminology,  so  long' as  the  raiio  Pj.  it 
larr.er  (likelihood  of  versus  than  the  ratio  of  the 


193 


■<’ 'lil' ' 


>■- 

fVj'  * 


T  •’  '^' 
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risk  {.0  )  of  aceopttaft  A  bAd  Aquipatnt  (fgT.bo  tho  proboMl* 
Ity  (1  •«)  of  cccopilng  a  good  cqulpMiit  (T))|  thoa  A'di* 
clsioa  to  accept  Ia  net  luatlfled.  ConvArAoty*  ao  lead  At 
the  ratio  ?t  ia  eaaller  (likelihood  of  T.  verAUA  To)  tbOBi 
the  rajio  cf  probe M  •A)  of  rejeniag  a  bad  A^uip^ 
ment  (T2)  t'<  the  risk  (a)  of  rajeetlag  a  food  equipaeat  - 
(Tx)  then  a  -ueclelon  to  reject  la  not  jaetified.  So  loag 
aa  neither  decislona  are  justified'  tKe  test  should  coa» . 
tlnue.  This  can  be  urlttea  as  an  inequality  fomula  at 
follows: 


<  Pr< 


I 


So  long  as.  neither  inequalitias  is  vlolat ad '’the 
test  continues,  .The  aoaient  either  Inequality,  is  violated, 
a  decision  la  made  and  the  test  halted.  If  it  iA  tha 
first  inequality  idiieh  is  violated  first,  the  deeieioa  is . 
to  accept.  If  the  second,  the  deelsioa  is  to  reject. 

The  following  algebPa  reduce  this  laequaltty 
forau.la  to  the  equations  for  Table  2  in  Section  II 
B-lc:  •  • 


/"  \* 

^\l2/ 


^  A#  ‘ 


taking  the  natural  logarlthe  throughout:  . 


^  't45-><»  *"  (-1).  -  -  ^)*  < 


■  .  JrT 

^  ’  'v  A'T.'V'  '[-y  V 

*  ■‘T  ’ 

■'it#' 


•‘w 

,  ,  •tjl  -t  ,‘r»^  1 


dividing  by  ^  throughout: 

.  ^2  ■  ‘1  . 


1  -« 


•Kl-)  . 

-  •  -  «  t  ^  - . - 

^  4  ■  •  -i.  -  i.'. 


12  n 


Ta  Ti 


19^ 


•VM' 


be  coof 
tlmej  c 


a.nrKr'sofcili’^I^In'of^M  SxponentUl  Case’’,  by  S  Ens^ain 
PP  82-93  ’  •  Mathewtical  StatistlL;  ter  1955^  ^ 
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'Since  it  1»  poseible  In  ft  eequential  tcet*  to  find 
It  necessary  to  continue  the  teat  for  an  eyter.aed  perloo 
fchen  an  ecriler  decision  is  not  possible,  it  is  of  Interest 
to  consider  truncating  the  test  at  a  pre-selected  tine  In 
-case  no  decision  is  aade  •ooner,  and  to  speOlfjr  arbitrary 
means  for  decision  at  the  time  c*"  truncation.  The  ob¬ 
vious  question  raised  relative  to  such  truncation  Is  the 
effect  If  any  on  the  two  rieka.ot,  and  >3 ,  both  of  which 
a£v«  fixed  at  10J(«  A  papei*  published  Iw  Epsttlxi* 
can  readily  be  applied  to  this  truncation  question.  He 
has  found  that  errors  of  approximation  in  using  tha 
Simplified  formula  for  sequential  test  design,  as  have 
been  used  herein,  err  in  the  safe  direction' such  that  the" 
actually  lower  than  the  values  assigned  when 
conditions  are  such  as  to  suggest  truncation.  According-' 
ly,  in  the  publisnad  paper*  the.  point  ftr  truncation  te 
.selected  such  that  truesC  is  maintained  at  its  assignsd 
value,  10%,  and  true/?  is  held  equal  to  or 'less  than  . 
its  assigned  value,  10%.  Table  1  of  the  paper  2  shows 
that  .lor  the  Tj/T,,  ratio  chosen  (1.5)  and  01  •  jd  •  &.10 
the  truncation  should  be  made  at  41  failures  (to  fall  the 
taut}  T  •  33  time  units  (to  pass  the  teat)  whichever 
such -truncation  tt'will  always  equal 
1C%  and  /?  will  never  exceed  10%.  Thus  the  sequential 
test  requirement  can  be  -accomplished  in  no  more  than  60%  ' 

o.  the  time  required  for  normal  test,  and  on  the  avecege 
in  less  than  30%  of  the  time  required  for  normal  test, 

-  .  ■  •  • 

2.  Production  Reliability  Index  Evaluation 

The  previous  section  establishes  the  risks  and 
confidences  applicable  to  the  sequential  test,  with  respect 
to  the  actual  e-iui.-^ents  tested.  This  section  is  concerned 
with  the  operating  characteristic  (which  dafines  risk)  of 
the  continuous  attrloutes' sampling  plan  employed  to  permit 
decision  as  to  acceptability  of  a  lot  of  equipments  when 
only  a  portion  are  actually  tested.  Also  the  means  ,for 
choosing  that  number  of  c'.ulpments  Which  permit  a  group 
sequential  test  yielding  results  at  the  earl iesl_ moment 
are  described. 

The  operating  characteristic  of  a  uampling  plan 
is  the  probability  of  lot  acceptance  versus  the  lot  per¬ 
centage  unsatisfactory  equipments.  The  user's  risk  is 
customarily  specified  fro®  scrutiny  of  the  operating 
characteristic  curve  as  that  percentage  of  unsatisfactory 
equipments  within  a  lot  for  -which  there  is  ft  10%  proba-^ 
bility  of  lot  acceptance.  The  producer's  risk  is  the  risk 
cf  an  adverse  decision  on  a  good  lot,  .and  is  also  obtained 
fron  the  operating  characteristic  curve,  usually  by  noting 
wh?.''  percentage  of  unsatisfactory  equipments  'within  a  lot 
give  9C<%' probability  for  lot  acceptance  (aiid  hence  10% 
probability  of  lot  rejection) . 


The  operating  c’naracteristic  of  the  continuous 
attribute*;  r-arpl  ir.g  plan  described  L'  Section  II.C  l-a 
can  be  calculated  in  the  following  way.  The  probability 
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^  probability*  for  aeceptane* 

Thut  Indrpenaentlf  a’tematl,  oourses  of  *v«it*‘ 

lic^iS  «"‘*i"r(i)  nrs^*- . 

redact  m  22  and  no 

r«j*ct  in  thf  'Z'  *“®  r«j*c6  in  22,  on* 

(4)  *'«J«ct  in  'sh*  next  50,  or 

Je-'t  in  the  next  37,  on*.r*- 

i  ^  ^  50^  aad  uc  J*dject  in  thn  n#vfc  ^  a#** 

M-cesalM^^xit*  P=‘‘»^tlllties  associated  with  #*ci»  pf  th*** 

rapidly  decrease  to  lnsignifle«ae* 

ir  contMbi.‘£  . 

PoissM's  Exponential  Binaatal  limit.  Similar!#  tha  ^ 
prebahilltf  of  exactly  ore  defectlir*  in  27,  ean^^  niltlolled 
ffar^th  exactly  tero  £n  3?  to  giv*  the  v«1m^ 

fnt  niternaties.  This  process  can  to*  repented 

*■***  *****  successire  alternative,-  and  the ' 

..,-atioa  reja-esenLing  the  process  can  toe  written: 

**f  •  ^(0/22)  «.  .  •  . 

?(l/22)  *  P(o/37)  ♦  .  ' 


'-,  '  T  •,  H 


^(2/22) 


X  P/-. 


{5/50) 


'■I-.- 


**(1/22)  xPjo/jo,  ^  . 

*’(1/22)  «  P(i/37)  X  X  ^  ' 

P(l/22)  *  P(l/37)  X  P(i/5o)  X  PjjyTjoj  X  (0/50)  .'*  " 

*•(1/22)  »  P(i/37)  X  X  P^/jQj  ,  ^ 

^{1/22)  *  **(1/37)  *■  **(1/50)  *  ^1/50)  *  '(1/50,  *  '(1/50, 

.  *  '(0/50, 

of  the  thrl;*c«^if  ••  “• 

•.  '®°*'thly  sasplir.g  as  described  in  Section  11. C  1-e 

seeu'ivi.  2Z.  *  *■='5 'ireaent  for  the  acceptance  of  22  con- 

L  *‘*''.* ?*•*** ts,  the  group  being  bn  occasion  as  few  as 

preyf"!^^.  ‘®  *•  *’*'*«i*‘*»  that  all  terms  of -the 

flrcZ'Jjr:;--'?  ^.f**®**?  ®'  22  *>*  replaced  with 

in  I  as  written  has  all  such  terms 

colS-e  appropriately  revising  this 

coiH..jj,  the  operating  characteristic  for  a  mc-nthly  sampling  of 
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It  should  ba  rotii  that  th*  likelihood  of  the  rt«‘4 
Iiabll'^te  lt:dex  cl  production  cquipaents  which  have  passed 
the  initial  rellehilitr  test  (22  «<{uipeents,  etc.)  suddenly 
urcepinp  end  there tr  unduly  risking  shipment  of  auhstandara 
*ru'.»ients  under  tne  C.C.  for  the  acntnly  suple.  Is  rather 
slignt  provided  changes  in  '■esiga,  changes  In.aaterlal,  etc. 
are  classified  as  reason  lor  requiring  retest  of  e  xinlieua 
cf  equipnents. 


The  nucher  of  equ-ipaents  to  be  grouped  for  test  to 
pemlt  earliest  test  decisitL  cay  be  calculated  by  writing 
.the  equation  for  waiting  tine  to  acrusviate  equipaenta  plus 
trccarle  duration  cf  test,  then  solving  for  a  9!iniB-.«  in 
t.-.v  customary  fashicn,  tlus;  . 


in  moaths 


where  h  is  number  in  test  group,  t  is  production  rate  in 
eruipceats  per  Kcnth<  and  T/Hm  is  «  conversion'tr  test 
txne  ~r.  aontbs.  based  upon  3tX)  hours  test  per  sonth  from' 
the  fcrsula  20f/X  where  the  test  tise  is  in  hours,  x  is 
still  expressed  in  hours.  '  • 


and  X  •  VH  ./S 


-L 

£  2iH^ 


?hf te  formulae  are  the. basis  for  eslculetlng  the  graph' ^  ; 
Figure  4.  •  '  .  ,  , 

D.  Selection  of  Test  Conditions  sad.  Procedures .  ’ 

pie  four  leve:  5  sf  itress  severity  for  environceo^l 
tei-t  c^^wXtions  were  enrsen  as  a  practical  coc;pro.‘ai8t  to 
cevrr  a  wide  range  of  actual, envlionmental  conditions*  Of  • 
the  tw?  -cajor  envircn-ental  factors  which  iwst  often  degrsds 
re.iariiity;  i.e.,  te.-wro'ure  and  vi&ration.  only  temper*-  ' 
turf  varied  in  the  various,  severity  levels.  In  some  ‘  ■ 
eases,  w.here  the  final  use  involves  other  important  factors 
5u:.'.  .??  extrere  vibratio.’t,  other  stress  levels  nay  .have  to  . 
be  uf?i.  In  sort  cases,  rowever,  the  caoabtlitv  of  an 
ecuioc-nt  to  wlthstar.s  the  vibration  can' be  determined  by 
cc.-;.-f".:icr.aI  type  tests.  The  special  reliability  tests 
car.  t-.ft  crove  the  svaot-ity  of  the  product  ouac.ty  under 
var.cus  iXtreoes  of  one  major  variable,  ’*» es^raVi.re* . 

The  appropriate  5tc-.dard  level  'f^,r  usd  on  any 
rro.ject  sr*cu.*2  zc  by 

tc  st-aalate  riujjriy  the  extreme  ccr.i:ticr,s  of  end 
wff.  T.-.f  thus  se.fctea  will  t.hen  arcl-/  to  *11  sucse* 

;.-'curtion  cf  ::.e  'are  item  su  t.ha'.’unifcrr  reliability 
IS  fv'sjOie.  T.-.e.-e  iS  no  Inrentio.-.  that  these 
c.  •  ; t.—.s  wil.  i.xnaust  -.r.e  various  fvV.oinatior.s  cf  en- 
v;-c-.rrrc  t.-.ai  cr-j^-  te  ir.clcied  for  tne  reliability  testing 
ccc.is.cr.a:  speiifi  -  e.-,.-c.-::,ta.  Ktmiaitr.  altitude. 


s.-.cr*.,  i.-.c  extreme  s-i' 


tav  ill  be  requires  in  son# 


|<a«?t'')''  '■ 
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*2^  "y  li’ 

■  ’■  '>;•%* 

■  '  ''  ■;'![  > 

s'"'*  .  *  'i 

/'T  .t 

,  .  ■  ■■..••  _  •  .  ^  -■ 

CASM.  .Th«  spteifiAd  *tr««A  l«tr«lA  ar»  b*  eonsi^rtd  «a 
■InlAttw  rai)uireinenta  and  should  he  extended  ohly  with,  full 
recognition  cf  the  attendant  coet  and  txai  delay,  and  loan' 
of  etaiidardlxed  teat  benefits. 

•  ^  '  ,  ' 

The  practical  consideration  of  site  of .environaentaX 
test  facilltics/renuired  to  test  that  optlitua  nuaiber  of 
equipments  which  will. yield  earliest  teat  results  4oev«r 
less  than  X)  must  be  Included  In  the  CGntractusl  negctlstions. 
Also,  the  delay  in  delivery  to  permit  testing  In  groups 
smaller  than  cptiisum.  In  order  to  minimise  cost  of  test. 

■  cllitles,  may  be  significant..  .  .£,■  -- 

for'  slnpllfleation  of  the  standard  test  sst-up,  cycling 
of  the  Input  voltage  was  nst  specified.  The  tl^eificd  high, 
side  Input  voltage  is  good  for  use  ini.  detecting' hot  spots  ‘ 
end  aai-ly  bum>out .  In  some  eases,  however,  the  use  Of  ;  : 

some  low  side  input  voltage  test  t lam  is  benefiel'sX.-  This  - 
is  particularly  true  xn  regard  to  detecting  poor  tuhSa ; 
wherein  smission  is  low.  A  cycled  input  voltaga  from  ’ 

high  to  low  value  as  specified  for  the  equipment -is  ■ 

easy  to  provide  when  a«c..lnputs  are  used,"  but  murh'iaofe'.  . 
difficult  when  d-c  .inputs  are  •used.  Added  emphasis  on  ;  .  . 
equipment  operation  at- low  input  should  be  Included-.ia 
applicable  "type  tests. .  -  '  ,  ; 

It  can  be  argued  that  a  humidity  environment  is  '-'  f> 
essential  to  reliability  teats  and  should  be  includea  in  ' 
the  specified  level*.  In  the  majority  of. cases  humidity  ^  \ 
is  a  slow  acting  fa<^or  and  it  is  felt  that  humidity 
troubles  which  do  not  show  up  in  the  type  tests  woold  not 
often  be  detected  in  the  reliabillly  tests,  for  Ihlh  .  > 

reason  humidity  is  excluded.  However,  if  equipment  is  *.  i.-  “ 

designed  to  operate  while  dripping  wet*,  this  condition  can  -.  '  . 
bo  met  by  moving  the  equipment  between  the  not  chamber  and  v 
the  cold  chamber  through  a  hum^d  atmosphere.  A  .similar-'.  " 
effect  can  be  obtained  when  using  a  single  chamber  for- 
both  neat  and  cold  tefts  providing  care  la  taken  to  •  '.• 

restore  a  high  humidity  to  the  chamber  on  each  heat  cycle.- 
A  precaution,  in  this  direction  should  be  observed.  If.  -. 
low  humidity  is  req-alred  throughout  the  temperature  test  * 
cycle  care  should  be  exercised  to  drain  off  the  moisture 
which-  is  condensed  <^n  each  cold  half  of  cycle. 

The  details  of  any  variations  from  the'speclfied 
severity  level  conditions  should  be'  clearly  defined  in 
the  contract; 

E.  Rela*"lonshlp  to  Other  Ttsk  Groups 

While  the  reliability  evaluation  wethodt  proposed 
herein  in  no  wav  are  der'.*ndent  for  validity  upon  the 
findings  of  any' other" T^sk  Orcup,  it  nas  been  .'■ecofnlzed 
from  the  .'■tart  that  ’luiual  success  of  all  of  the  Task 
Groups  is  essential  t  -  the  yield  of  ma/iir.um  reliability 
benefit  to  the  militar.'  sc.-viccs  ‘‘rem  tne  effo.-ts  cf. 

Ta.sk  Group  3.  The  nature  of  such  Irdi'-eot  dependency  is 
set  forth  in  the  preoabie  desco,''.cSing.  order  of  significance  . 
in  the  following  pan  graphs-. 


X- 
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1.  Us«r'«  Mlni^  4ccft{>t«bl«>  RiiiifblUty  Iai*s 

.  It  i»  that  T«tk  Croup  1  will  «omm 

tactical  requircaants  and  will  convart  all  applieablo: 
factors  Into  a  single  nusarlctl  figure  for  Biniwuf.Mtif  ' 
for  each  squlpfflent-catsgonr  or  type.  TUs  flgurt,  whieh  , 
will  hereinafter  be  identified  as  Ti,  beeoffles  the  Pasio  '  ‘ 

paranater  from  which  to  uitlaately  derive  the  sinlaw 
specified  MT8P  for  Task  Croup  3  evaluations.  5.'  . 

2.  Reliability  Segradation  Related  to  Xainteiuuiee'fvJ|?^‘^l||| 

It  is  anticipated  that  Task  OToup-9  will'- ecBslder;<'MfJ';fel^^ 
possible  reduction  in  reliability' free  that  value,  at-/ ' 
tained  during  manufacture  because  of  various  -aspecta'-'Pf 
field  maintenance,  such  as  practical  aAlntenance'^^Utinea, 


can  be  developed  for  each  significant  e.quipotot..cate8S|7;V^^w^,, 
such 'that  MTBF  prior  to  maintenance,  To,  1*  equal  \ 
multiplied  by  Kq  (vis.,  To  n  KoTi).  ‘  '  ,i,  v.f, 

•  .  •  ■ ‘  '.V.  .  .  ■" 

3 .  Reliability,  fiegradat  ion  .Related- ,  to  Sto5ra«i' "  •  ;4 

It  is  antlclpatsd  that  Task  Ofoup  R-wlll  :Consider«:V?''iJ|l^ 
possible  reduction  in  reliability -ei  a  motion  of -Stoiake^rfiS^lf#, 
conditions  and  sto.raga  time,  for  sigr.lfi«iht.;aquiisisat:  • 
categories.  It  Is  prasu'sed  that  such  factor#  can. lih  .5' 


taken  into  account,  to  yield  a  reciprocal' aultiplyiag  ear.  ’ 
efficient,  Ko,  such  that  MTBP  prior  to  storaas,*,Ti‘  '  ■*“ 
equal  to  MTBP  required  after  storage,  To,'atuIt: 

•Kg,  thus  yielding  the  equation  .  '  . 

/  .Tg  -  Kg  tq  -  Kg  Itq'Ti  . 


>is' 

,ed 
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4..  .Reliability  Degradation. Related  to  Transportakliii^^^l'g: 


;C;  *- 


It  is  anticipated  that  Task  Croup  7  will  consider: 
possible  reduction  in  reliability  as  a  .function  of  expeeited:;u-'#Sif^J^^^ 
conditions  of  transportation  and  handling,  for  .elgnlficeat-  -^.'';#3^it?; 
equipment  categories.  It  is  presumed  that 'this  factor 
be  inversely  represented  by  a  coefficient,  K.,;  stieh;that  "1:r  ' ' 

KTBF  before  transportation  and  handling,  Tv, 'is  equal  to 
MTBF  after  transportation  and  handling,  Tg,  multiplied  ly'' 

Ky',  thus  yielding  the  equation 

T7  .  Ky  Tg  a  Ky  Kg  Tj^  -  Ky  Kg'K^  '  .■  3'  ’ 

'  5.  .Relationship  of  T  to  Tj^ 

As  previously  stated  the  aininmm  MTBF  specified  by 
contract  for  pilot  production  and  production  evaluation, 

T,  must  be  chosen  to  be  5CJ(  great»'r  than  the  MTBF  actually 
required  In  the  delivered  equipment,  Ty.  Thus  T  can  be  .ra» 
l;»ted  to  Ti  by  the  equation  r  ' 

IS  •  1 « 5  T7  » 


1.5  Kj  Tg 


1.5  K, 


To  1.1.5 


6.  RalatiOBShip  of  Jtinlaua  XTBP  for  DovolopMat 

It  i«  uitlelpatod  that  Task  Group  2  will  coneluda 
that  ths  mlnimuo  acoeptablo- KTBF  of  a'julpnent  Ksasui'ed  dur<»  . 
lag  tho  davslopoant  si^agef  mist  boar  sobs  fixed  ra> 
latlonahlp  tb  the  aiiniffluffl  aceaptabie  M?BP  for  pilot  production 
and  production  aquipvent  (T),  such  ralationshlp  being  of  tba 
forn  of  a  multiplying  coefficient^  X^t  either  j$reater  or  laaio 
than  unity,  and  varying  among  si^lfleant  catagoriea'of  ai^uipr 
Bent.  Thus  it  is  presumed  K2  can  be  chosen  -as  to  perait 

>2  *  H  ^  ■  .  •  '  ■ 

,  •  ,  t  n^-'.  !«*•  ^ 

'  •  ‘  1  , 

;  7*  Relationship  to  Task  Groups  4,  5,  and  6..*'. 

The  procedure  prescribed  by,  Taax  0i%ttp'4t  when  fol-  .* 
lowed  by  a  contractor  during . aquipoent  design  and  develdposntj 
should  establish  with  relatively  high  confidence,  M)  the  ; 
probability  of  pa&slng  the  reliability  tests  for  dsvelooaent 
squipaent  prescribed  by  Task  Croup  2,  and  (2)  the.  probability 
of  passing  tho  reliability  teste  for  pilot  oroduetion.f re-  • 
scribed  by  Task  Group  J  herein*  .Additionally,  the  Taak-* 

Group  4  procedure  should  permit  rapid'  identlTicatico  of;  ^ 
areas  for  initial  redesign  attention  in  those. caeeis  wher# 
the  reliability  aa  evaluated  by  Task  Croup  2  or  4  tests  is 
found  to  be  Insufficient*  ' 

The  recommendations  of  Task  Group  5  should -ultimatsly- 
result  in  the  yield  of  roflaod.  reliability  data  for  par.ts  end 
components  idileh  permit  improved  accuracy  snd  confidence*  ..  ' 
for  the  reliability  predictions  mad#  in  accordsnee  with  tlM 
Task  Croup  4  procsdurs. 

Tht  findings  of  Tftsk  Group  6  are  presumed  to  be, of 
assistance  to  the  implementetlan  by  contracting  procedures  . 
of  the  findings  of  each  of  tho  other  Task.  Groups*  '  ■*" 

^ '  * 

IV.  CONCLUSIOKS' 

The  members  of  Task  Group  3,  assisted  by  expert  coa-' 
sultants,  have  gathered,  reviewed,  developed,  and  largely 
co.nfirmed  such  information  as  permits  them  unanimously  tc 
agree  upon  the  following  major  conclusions 5 

1.  Practical  means  exist  for  performing  quantita¬ 
tive  evaluation  of  pilot  production  and  production  models 
of  electronic  equipment  which  will  determine  conclusively 
whether  or  not  the  equipment  meets  the -specified  minlmuB 
acceptability  figure  for  reliability. 

2.  The  testing  methods,  set  forth  in  Section  II 
of  this  report  and  discussed  in  Section  111,  while  ul¬ 
timately  requiring  conversion  to  doctrinal  forms  such  as 
Directives,  Instruction's,  Memoranoa,  MIL  Standards,  or 
MIL  Specifications,  fulfill  the  basic  objectives  of  this 
Task  Group's  assigned  misslori  and  satisfy,  the  criteria 
laid  doivn  'o.v  tba  Task  Croup..  Importantly,  they  conform  to 
tne  following: 


a.  Decision  bases  are  clearly  defined  and  do 
not  depend  upon  tho  judgment  or  experience  of  any  agency 
or  personnel. 


b«  Th«  terhnl^u*  •nploy«<i  for  ovaluatXM,  whil* 
prrsontly  Judged  eompletoly  practical  and  efficient,  eaailp 
lenda  iteelf  to .future  Improveaent  aa  experience  and  ad-  - 
'  eaecing  state-  ',>the-art' perait* 

e<  THe  nethoda-  and  procedu«^a  are* independent  < 
of  and  can  accept  an>  numerical  valuea  of  mean-time- between- 
failure  apccifled  for  an  electronic  equipment  and'  therefore 
are  independent  of  variaiiona  la  operational  requlreaenta. 

d.  T))e  methods  while  developed  to  permit  inaxlmum 
benefit  when  applieJ  in  conjunction  with  the  findinge  of 

the  other  AG/IEE  Task  Groups,  can -be  implemented  without  sup¬ 
port  from  these  other  groups  by  permitting  the  procuring  - 
agency,  to  establish,  arbitrarily,  or  otherwiaa,'  a  value  for 
aiaimuffl  reliability  acceptability. 

e.  The  methoda  set  for-'h  ara,  within  the  •xiknV 
of  tha  ability  of  the  Taak  Group  and  itii  conaultanta,  optimun 
tdth  respect  to  ease  of  specification  and  admlnlstratfon:  aad-^ 

-  with  respect  to  aconomy.  of  both'  funds  and  tima  schsdulo* 

fj-  Tha  test  methods  If  admlhlstered  ai'  pfb--  '  ■ 

scribed  herein  are  suitable  for  ixissdiate  implementation  - 
with  or  without  a  period  of  trial- use,  by  any. or  all  of  ^hs^  - 
.  procuring  services.  ■  7  •  . 

3.  The  testing 'methods,  sot  forth  herein  in  complin  *' 
aaee  with  the  evaluation  mission  a-sslgned,  pjovide  'specific  ’ 
teat  routines  for  (a)  reliability  index  evaluation  of  .pilot  - 
production  equipment,  (b)- reliability  index  evaluation  of.;  ■. 
production  equipment,  and  {c)  longevity  evajuaticn  of  .pilot 
production  and/or  production  equipment.  -'This  separation 

of  teat  routines  permits,  respectively,  (a). establishment 
of  eapablllty-  for  meeting  mihimum  reliability,  requirement, 
based  upon  the  .greatest  testing  economy  with  respect  to  ', 
number  of  equipments  tested  and  testing  tine  required,  as  - 
judged  most  desirable  for  pilot  (a'oductiqn  equipments;  (b) 

'  statistically  conclusive  proof  that  an  acceptable  per¬ 
centage  of  quantity  produced  equipments  each' meet  a  miniaun;. 
reliability  requlre-ment,  with  maximum  economy  pf'tesr  cost, 
and  time;  and  ( c)conciuslve  proof  that  equipment  reliability 
does  not  degrade  during  the  desired  equipment  life  belOw  a 
prescribed  minimum  level. 

4.  The  testing  methods  set  forth  herein  are  de-  '  .• 
veioped  in  Such  a  manner  that  they  are  reasonably  immune  to  • 
tampering  by  the  contractor  or  by  prejudiced  testing  per¬ 
sonnel.  In  addition,  selected  redundancies  in  data  handling 
render  the  testing  methods  reasonably  self-checking  and 
inmune  to  errors  in  data  recording.  Specl'ilc  means  for 
accomplishing  the  evaluations  are  described.  These  means 
take  the  form  of  detailed  testing  methods,  circumscribed  by 
complete  rules  for  administration  and  procedure.  Parameters  . 

■'  for  election  oy  a  pr.icuring  agency  are  only  those  which 
must  relate  ( l}  conditions  of  equipment  end-use  .tc  the  testing 
procedure,  and  (2)  conditions  of  procurement  volume  and 
scheduling  to  tho  testing  sequence.  Factors  which- cannot  ' 
affect  evaluation  conclusions  but  can  affect 'testing  con¬ 
venience  .are  left  for  election  by  the  procuring  agency  or 
the  contractor. 


5<  .The  t«stiRE  method  *9  herein  prescribed  for  the- 
evaluation  of  pilot  production  equipment  la  well' .suited  to 
permit  mandatory  requirement  for  minimum  reliability  of 
pilot  production  equipment  prior  to  authorization  of.  reitulsr 
equipment  production.  The  testinfc  tine  required  to  prove 
eniBj.) Ion..*  }«  I'olicYci  ttOMsioerably  less  than  required 

by  any  other  known  ^esently  used  technloue  yieTdinff  equiva¬ 
lent  quantitative  assessment,  and  is  considered  eom^tlble 
with  typical  schedu’lini'.  The  number  of  equipments  required 
for  test  is  so  minimized  as  to  fe  quite  compatible  with  the 
volume  of  pilot  production  equipments  cuatomarily  p-o'ured. 
The  nature  of  the  prescribed  test  is  sucn  as  csn  reasonably 
be  considered  non-destructive  to  the  equipments  tested, 
thus  not  compromising  equipment  intended  use  or  appliestlpnl 

6.  The  testing  method  as  herein  presoritoed  for  the 
evaluation  of  production  equipment  la  adjustable  in  ac¬ 
cordance  with  rules-  set  forth  to  be  compatible  with  an/-', 
combination  of  procorebient  quantity,  production  rate,  and. 
vquipment  complexity.  Where  production  rate  is  moderate 

or  high,  tha  testing  method  employs  a  sampling  tecnnlque  per 
mitting  uniform  high  confidence  with  respect  to  the  relia¬ 
bility  of  each  delivered  equipment’,  yet  requiring  the  actual, 
test  of  but  a  sample  fraction  of  these  equipments  bn  a.  zen- 
tlnulng  basis  that  is  sensitive  to  any  .later  reliability 

■  Jeterloration.  Adjustment  of  the  testing  routine  in 
accordance  with  production  rate. permits  jontihuous  yield 

of  reliability  acceptability  in  the  shortest  elapsed  inter-’ 
ya_s,  thus  augmenting  early  remedial  action  of  any  observed 
ahortcomings.  .  ‘ 

7,  The  testing  method  as  herein  prescribed  for  the 
evaluation  of  reliability  longevity  penr.jjt5  initiation  of  • 
test  either  at  the  time  of  pilot,  production  evaluation  cr  . 

■  at  the  time  of  initial",  production  evaluation.  The  an-  •' 
tlclpated  duration  of  the  longevity  test  period  is  such  as  . 
Is  likely  to  be  incompatible  with  the  scheduled  pteriod  fer 
pilot  production  alone,  and  yet  be  of  sufficient  importance 
to  the  equipment  program  to  warrant  findings  at  the  earliest 
practicable  date.  Accordingly,  where  pilot  j>rcduc.tion  and 
production  equipments  are  reasonably  similar,  and  where 

’  longevity  evaluation  Is  desirable,  the  evaluation  should  bb. 
begun  early  in  the  program  during  the  pilot  production  phase 
and  trAnsitlon  to  production  should  not  await' longevity 
findings.  . 

6,  Statistical  elections  .with  respect  to  the  test¬ 
ing  methods  herein  prescribed,-  have  all  been  made  on  the 
basis  of  105t  user's  risk,  1C5{  producer's  risk,  and  90%  con¬ 
fidence.  Formulae  are  included  herein  for  altering  the  . 
test  method  to  emp.loy  other  levels  of  rlsx  and  confidence. 

It  is  the  belief  of  the  Task  Group  that  the  risks  and 
confidence  chosen  are  ajstly  suited  to  the  Task  Group  • 
mission. 


r.  escdOfcxtiAnoKs 


1.  Task  Oroup  2  reeomaands  that  the  material  Included 
h«re'«lth  in  Its  Final  Report  be  referred  by  ACRES  to  . 

OASD  ( ENG)  for  review  ani  ccament  by  the  procuring  ,  ‘ 
branches  of  the  three  military  services  with  respect 
to  the  practicality  for;  '  >’ 

Trial  implementation  on  several  selected  contracts  " 
for  pilot  production  electronic  e<piipoent  within  ; 

a  prescribed  time  interval ;  Kan-iitory  Implsmentatioa  .  = 

on  a  wholesale  basie  on  contracts  fcr  pilot  produce .  tf; 

.  cion  electronic  equipment;  Trial  teplementation  on 
production  contracts  for  electronic  equipment  which  ;>x': 
follow  implemented  pilot  production  contracts; with  ' 

-  the  same  contrcctor;  And  mandatory  iapleeant'ation  on 
both  following  and  new  production  Mntracts*  /  OT- 

i.A  Taek  Croup  2  reebomends  that  AGREE  urge  OASP 
at  the  earliest  practical ■  date  and.  independent  of  the^  -’  y- 
previous  recommendatipn  above,  to  select.-  a  limitM.  S>^hP'  j'-- 
of  pilot  production  contra'cts  for  electronic  equipment',. 
placed  .by  a  variety  of  nroeur^  br«nehes  of.  the  three  '  .5 
servicee  with  e  veriety’ of  contractors,  upon  which  to‘, 


make  mandatory  the  ecmpliance.  with  the  herein  prescribed-#' 
method  for  reliability  evaluaticn  cf  pilot  productiwi  •  ■ 
equipBwnt.  'C\ 

3.  -.  TAsk-droup  3  recommends  that  AGREE  urge  OASO  t^/,- 


/  '•.rf ' 


at  the  earliest  practical  date  and  indepeniently  of  the-  ' 
two  previous  recommendations  above,  to  select  a  limited' 
group  of  production  contracts  fer'  electronic,  equipment., 
upon  which  to  make  mandatory  the  compliance  with  the 
hirein  prescribed  methods  for- reliability  evaluation  of 
production  equipment,  wich'.ut  regard  to  whether  or  not 
pilot  production  versions  o;  tbs  same  equipment  hays ' 
been  evaluated  in  accordance  with  the  -herein  prescribed  - 
method.  .It  is  further  urged  that  a  selected  portion  of 
the  chosen  production  contracts  be  subjected  to  the  ■  - 

longevity,  evaluation  procedure  prescribed  herein. 

li.  It  is  recommended  that  GASD  {SSQ)  arrange  to  review  • 
the  test  elections  made  by  the  procuring  agency,  under 
paragraphs  2  and  3.  and  to  review  both  progress  and  ultiaats 
findings  of  the  contractors  in  order  to  Insure .that  the 
method  is  applied  as  intended  and  that  the  results  satisfy 
the  original  requirements  cf  the  Task  Gro-up  mission.  If 
each  or  several  of  the  three  prerit-as  recommendations 
above  are  independently  and  sitaltar.eously  implemented, 
it  is  j-econunended  that  the  r^r.r.ir.g  observations  and  find- 
.  inrs  from  each  be  used  to  pi-ovide  ninning  benefit  to  the 
ot.nrrs,  to  tne  end  that  recoicendaticn  5,  below,  can  be 
safely  impler-ntcd  at  the  »er'  lest  ;-ssible  date. 


‘i.!; 

1/’!''  i  MSI*. 

■i.'t 


5*  Tnak  Cnup  3  rtpooMiulJ  that  ACRES  urge  OASO  (IVB) 
to  follow  up  the  above  reeomeodatlone  at  the  earlieat 
praeticabi*  tine  with  eaiuUtory  requireeente  for  w- 
liabillty  index  eyaluation  as  prescribed  herein  (or 
logical  extension  thereof)  on  all  pilot  production,  and 
production  procureswnt  bjr  any  of  the  Kilitary  servleca  ' 
for  electronic  cquipcent.  It  la  suggested  that  longevity 
evaluation  as  prescribed  herein  be  left  discretionary 
with  the  procuring  services. 
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-  >Udlo  Ciirj’omtlon  of  Arwrlci 

-  Conwilr  (Fonon^). 

-  jV*nd'.x  Division 

-  Collins  Rndla  Conjv\ny 

-  ISi  nal,  Cor^ifl  Frvinecrln/'s 

-  IXirenu  of  Slilfs 

-  J^ational  ."uri.au  of  Standarila 

-  Air  Dcwlopocnl  Center 

-  Home  Air  Dcw?lop:it*ni.  Center 

-  Amy  Crdnanco  . 


In  eon^ciion  with  the  stiujy  of  the  leak  ttaUpti  to  Task  itraep 
Ko.  !i  t?  Investigate  and  recomend  Jwthwds  of  sj.'ecifyihC  develop- 
nent  treced;Tes  to  that  e^ulpnent  desirns  vill  .-lawe  the 

if*er.-nt  reliability,  ne^^ired,  a  tttltm  of  inihlieations  and  the 
previo<.ts  work  in  bonneetion  with  the  problen  was  eondueted.  The 
procedure  is  intended  for  use  in  oonnectlon  with  eontraete  tat 
ths  developncnt  arJ  desipn  ,f  equlpmnt  planned  for  produstloR*  •  t  *■  -  -* 
7t  is  assuncd  that  rrevious  destaren-and  Develorwr.t  work  tiae.  ' 

.establ  idled  tne  necessary  background  knowled/e  to  rett'.it  the  pfe- 
(•nn  to  i*  carried  out  without  rtseareh  to  detemine  neano.for 
accanplisKinc  the  perfomanee  of  the  ISinetion. 


lafemation'obtalned  throum  field  trir.s  arronred  rrevi'wsly  by 
A,j.R-.i:*£.  was  taken  into  account  in  ettfnrtinr  to  u’  ’iid  the- 
Rwieraus  factors  wMch  enter  into  the  sanplex  pTotle  .  tcae 
of  its  corplexity,  there  is.  required  en  orderly  eensit  .on  and 
coordination  of  ell -factors  affecting  the  Reliability  ::  systene 
in'  tiie  planned  use.  ’  _  .  •  '  .  ' 

In  visits  to  oevrr.il  nllitarj^  eouljjflent  Install&ttons-  and  die- 
caosions  witii  t»:e  peeple  usinp  the  e.ottiment.  It  was  fouirf  thet  "  -  ■■ 
there  was  conslde5“-otle  critlc’s-i  of  Vit*  d^inns.  whicli  iniicated’ 
to  tw:  Uiat  the  desi-her  had  no  knowicUre  of  the  enviromentiil, 
naintcr-once,  and  oceratin.--  rroL-lens.  The’-Rort  cucceosfiil’dtsipnero 
of  co.onercl.-il  rrj.-h/ct'-  art?  the  cr.rio^rs  icjo  .have  e’Voroueh  knowl- 

ed. -v  and  uaderstandinr  of  the  user’s  situation;  Tor  .tiwse  reasons, 
we  co'a’der  tliat  the  finct  rnouire.'ver.t  to  he  suited. in  the  *"Ro- 

ee. t-ure  Is  that  ti:e  cortractoro*  errireer?  be  rade  thorou.dily 
ra:-.iliar  «:U.  the  u-..T*3  sltu-otSon, 


is  .mot:.er  dlfr-»rrr.cc  in  *JtC  'roilcn  of  a'iartir..-  t-ie  eijuip- 
r.i'ct  to  t-x  er.d-ucer’s  rc'p.Jrer.t  rto  in  case  of  nilltary  eiuijner.u 
as  c o-.c-irdJ  to,  corrir-rciai.  Ic  the  case  of  nllit.-»r;- 'chjicrrr.t,  a- 
Sjifcii'ic  ru.ol«r  of  en.i'c.  nts  is  ordoied  by  eonti-sctj  .orsd  tne  c(jsip»j 
rent  is  usaolly  rvwufaclu^  Jz-rar-  tier*  is  fecdieici.  fror.  tSie  user  .. 
to  the  :-'rodueer.  of  t.-;*-  chulcocnt  rh-ort-coninj;*.  in  tie  case  of 
ce^*v'rcirl-equlf.-ncnt,  feedback  torins  with  tne  first  snipoer.ts  of  . 

so  tat  t:*  dt  :»:•*;  vea’cx-sscs  can  be  corrected  }*fore 
iar.'c  scale  [.roductior.  tvts  -place. 


T.he  .iesipner  of  nilltary  ’electronic  equipnent  Is.  in  sora  resixets, 
cjrfior.led  with  a  •’Dl-i's-.  sh-.ilar  to  t-v.-il  c-onfrontinj  civil  cn- 
rit.eri  who  rent  dcoipi:  'crid-' s,  tuii-iinrs,  etc.,  sn-:  viio  rr..st  t« 
c'-i-l-iir.  t-sit  tic  slrjcUirt;  will  tx  sifc.  It  is  tr.cSr  ;  raetice  to 
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n*itc  «  aii  of  tie  Tact^rs  4*lPh  *•.'»•«.  ■  ■■•-  •»  th# 

tyre  of  destiTi  iiiat  is  required.  Tlk-re  Is  «ii*s  f  to* 

Ivisie  ehar»ie».erl3tjes  of  fjiterlal^j  and  tiie  s|»8ifi.oat.ions  vaed 
for  rrscuriRT  naterial*  ton  be  relied  uron  to  assur*  iHat  to* 
na^erials  neet  «  sreeifled  de(rr««  of  unitorsltj.*  in  re<»r*l  to 
Sireie'tt,  elastic  it;.-,  etc.  ~ie  clril  e^-ircer,  houewr,  ntist 
estinste  t:«e  sti'eet  of  .lis  t*!rticuir“  use  of  U.e  roterials  uj«B 
toe  safet;-  of  toe  struetane  ha  designs.  Sow  of  ts-w 
are  inteir-.itter.t  aests'.er-Jsadin,-;*  vicratisn,  cor^osiori*  *te» 

Tfit  rroce<la-e  dt-'/-  .iored  h;  ’’as';  (isouc  fJj,  1;  '‘sK.-jiatoS  t;*  br?^ 
of  dt-sirrin-’  systci^  to  rrovMe  '‘■sr  tos  required  systorwi 
reliaMlity.  it  rec-ircs  ail  of  toe  factors  t-^t  sffecl  U>a 
syaten  reliai-ilH;.-  le  to<«r  itito  aecrsnt  v:itn  cliRfjiiig  Uic  pn^ 
osced  liesi^Si.  An  uft.ut'rr.t.T'iinr  >f  t».e  iijraaa  :,r3i/ie:i  clariflr-a 
t.Mi  r.atyrc  of  toe  .v.ny  ssl-sidlarj"  rro'.-Ieas  it'd  thus  ^ads  to  . 
t.;o>r  sslatiof..  ,  i*:reri"tisc  .iss  s'.ivin  Uwt  orce  S  jratitet  la  '■ 
ufldcr.t*^d  na*  arasine. 

Tie  nature  of  tie  rwtliia  indiaiites  that  axf  resr-of.ttiMllty  ^ 
shout.!  te  placed  or.  t:;e  !.ontractor-and  tie  desis:!  encioeers. 
«quirj»nt  tjist  .ulll  be  sotisfactorj’  t j  t-ho  user  and  iiist-  Iqss 
rf-iiance  wsulu  S».-  r  laced  on  dctoVlei  sceeifieations  supplico  tgr' 
t.ic  t  rocureoer.t  art-i-ci*,  ..  ’  , 


-f 

*',i 


The  tr^furinr  areclf^  tae  r&dtirtd  r&Xi*ibiJlity*. 

■ifceiric.atlor.  is‘rear.Ir.rie55  unl.cs3  tot  rc.-isirsacnt  la  statad.ia- . 
oitantitoti  VO  terns.  '  .  '  •  f  ':- < 

.  .  '  '  .  ,  ’■‘T 

T=io  trocedure  exrlai's  Irlcfi;.'  tire  nature 'of  toe  enclneerinr 
•  Iqn.  invnlw-d.  it  stotc.s  tiat  tic  contractor  nust  abtiir  an‘UB<|**r_.''‘;,'t,^''.  • 
stofiiinr  of  t.Te  fur.ct;on  t?  be  rerfasned  by  to*  eqaIrWtV  eneirwi*'-?'''^  • 
nent  ir.  K^iJdo  toe,  C7..ir«nt  rast  to*  ; 

pvrsoimcly  and  huriar,. cr»*ine*»rinr  factors  tost  oust  be  consi-towrt;.  '* 
to-prsobie  for  too  :r>st  effective  use  of  the  equipner.f,  -  /  . 

the  rroeedure  eansists  of  tuo  baste  phases,  fhasa  X  is  a  feasititlll^f'T^''^ 
stsz«!y  to  be  ter.'.i.nated  by  a  r»'rort.  The  report  is  roqulred  to  e*i>*l,  L- 
toin  infornation  V.at  can  be  used  to  evaluate; toe  contractor's  unflwi;;’''/' 
standlnr  of  the  probiens  and  Uic  prooal'ility  of  equipnent  bein^  .  }, 

dewlaped  th.at  w!-ii  >-et*toe  nUitory  dtpartoents*  re.(ai*»teB*s.'y 
i.i.vie  II  reip'es  to  des'rn  snd  eoostnwUon  of  the  rarototyre  »od^’^|*? 
Tliis  phool*  is  to  be  -irhert.-iiten  only.sfter  the.  Hiasa' I  rer-ort  has.;.' 

!*'en  evaluated,  con'-ror.ist-s  reached  if  reqai^J,  ani  the  secpe,*f ' 
tiie  desim  frorrm  is  u.nderstood,  . '  Vv 

In  ot»ft-r  for  toe  contractor  and  his  de.slra  e-nrincers  to  arrive  af  •; 

t,'.«  Ifthen-nt  equifrc'-t  rell,ibiiity  reqi  Ired,  it"  is  necessary  to  -‘  j  - 
estlnatc  tic  ef''ectivcncs;'  of  toe  sroritiur  rcr.-iorcwi.  ie  toe  oyer^ 
atJnp.environoi’nt,  naintoirai.tlity  of  -toe  enuis'-Of-nt  in  erd  use,, 
mobility  of  detori  oration  .of  reliabllit..  :l*j  to  the  environnent 
in  aii’sch  Uie  5;'otor.  will  orcrolc,  deterioration  and  .otori’  , 
shir-rint  ■'•r.'i  .It  is  realised  tnaV  tnere  -.s  little  orn*  ’ 

.stoti.otical  Inrom-,5,;o.'.  awiii-otle  at  jTC-snr.t  to  rc’.ar-J  to  these 
effect-.,  if,  ’iMrinr.  *.‘.c  'icr.-s^.  of  toe  e»js»i.rr.er.t,  tie  field  profclens  *  . 
arc,  carefully  eoaoiderr; tr.e  dctoriorot.or.  i'r.  r^iiaHiSty  of  use 
bc..o  r''I--ti.v.'iy  s  .,11  f.ictor.  7.k>  rist— *.  .-li .roouirc^sent 
:o  for  J  ;p  'ier.,!':  vr.-ir>»r  to  stuTy  Vh’  rirjh'.’.ns  a-.d  to' plan  his 
';t3i,~r.  so  .0.0  to  rir.toice  ■'•otlur'.'o  dup  to  r>l-i  ccr^iitioi.s.  There 
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nn  in  effect  ttut  wUl  pnvidc  infsimtiMi 

.  ir.  rt'carj  to  tiicse  factors'  viiCr.  the  studies  haw  fcecn  esRnJeteJ* 

(ASiKO  Heiiability  Assurance  Trsi'ran  bc-itif'  esndueted  far  .the  Air 
farce  is  sne,  arrf  V'ltrs  f(«itobiitty  Studies  eur/ert  far  SuShips 
is  anather.) 

»iie  j;»eeiiure  sutllres  s  aethad  af  anslyzlnr  a  systen  to  deterslne 
toe  relial’illt.y  recr-i**-'^-to  far  parts  if  t*  sj-stes  Is  ta  nset 
the  ri'lia^^iiity  opecificatlan.  Whet;  the  re<juirer.er.t5  far  '•rts 
rcliabilitr  ar*  bnierstoac  arc  arc  svaud  in  terns  of  teruissible 
faliare  rate.*,  t.c  prablc*  is  toar.  resolved  into  one  of  deterrinii^ 
id.etner  ar  not  parts  c.an  te  ablained  tort  east  be  used  In  the  as- 
setsbijr  in  sue!;  a  nanner  that'  t.hc  reipiired  reliability  cAr.  be  nat* 

At  toe  rrcser.t  ttoe,  toere  ^  feu  sreeirieatians  in  existence 
that  require  testirp  to  detorsine,  vitoin  a  depree  af  assuraneef 
ti»at  fnrts  Kill  rret  a  steelficd  -failure  rate  then/Ased  ender  sreel-  ' 
flea  carditians.  'he  use  of  this  -raeeduie  Kill  besvlt,  we  .bciiew, 
i»  tiie  detelntTi'T.t  of  suitorlc  srccfficatians.  -Parts  failute  rate  . 
d-ato  itaee  ‘r-jch  callertcd  ■t.'inu^'-ficii  failure  retorts  arc  life  .  ■ 

'tedts  ihat  stave  been  candueted  an  eqt-lrnenls*  If  this  data  In* 
d^cato-s  toat  available  tarts  ra*la?ilily  is  isvade-tuate, -toe'et^ 
rirvicr  will  necessarily  'nave  to  arrantte  far  srccificatlaris  end 
tests  ta  r-tovc  toat  narts  eas;  l-e  abtained  t^ut  he  Mn  use  in  sueh--^  ''  ’ 
a  v.iy  -toat  t.-.t  reauirswent  is  r»t,  Tas!:  iJrasp  I’a.  5  has  nsde 
ir'canfam.latians  nscardinR  rsrts  sneeiflcatians, •-•'  -  '  •*.  / 

The  retort,  utsdn  ranpletian  of  Ibase  X,  shirald  i^icate  the  study 
toet  has  been  "ade  by  toe  eantraetor  in  rsfwd  to  all  af  the  -re*  ■ 
quirestents,  the  type  af  desifn  eantenclated,  and  shauld'state. 
vheto.er  or  not,  tne  eantraeian's  aralysis  isidiaates  that  toe  requirew  . 
rents  e*n  ‘j€  rsft.  On  toe  basis  or  tnis  re.rort,  toe  rrac-arln;;  ethmey 
should  able  to  evaluate  the  r~>bal'iiity  of  toe  rwrosed  cesim 
nectinr  tiKi  req-iirt^ents,  it^ludinc  reliability,  iefore  proceed-  * 
inp  uitii  tl.e  de-ilpn  nti.ssry  t»»re  s-hould  b«  vrrier»tit  U«tutea  the  • 
sracurin?  agency  and  the  eontractar  Inat- retjuircnents.cau  be  nqt 
ani  tost  there  is.a.hiffi  crababili^  af  equi;nent  being  crnduced  ' 

•  that  vill  .have  toe  specif.ted  reliability. 

•  e  e 

>hase  JI  of  toe  rraeedure  relates  to  the  desim  and  construction  ■' 
of  toe  irototyves.  Certain  re-^ulrwents^are  outlined  to  connection 
Vito  the  selection  of  parts,  criteria  are  riven  far  asser.tiy  des.'^ 
teehni-^ues,  and  stress  is  t-lAced  upon  toe  selection  of  design' 
teeiinSows  tint  will  satisfy  the  re^uirenents  for  reliability  and 
nainfc»iT.abiiity,  Corse  reouirc-ents  arc  stited  in  regard  to  en-.  *" 
yirorrentol  Cotoideratio.hs,  -ech.or.ieai  strictores,  and  nanufaetw- 
inf  tocar.inues."  Tt  is  cnntcr.ntoteil  tf.at  toe  :r»totyr-os  will,  be  cvals;- 
oted  in  AcnriAr.ee  vlth  toe  rroeed-ure  de'vel->ped  by  Tasfc  .'ro'.'.p  "a.'  *. 

Vron  Corpletion  of  toe  eralu-vtian^  the  contractor  is  f^uired  to 
s-jirsit  a  ro'ort  •iescrlbin.'-  varioi?  c'namcterictics  if  to.e  e-piir- 
-o— t,  an  ar.nlysis  of  tne  ev-;lu»tion  «:•;  re-’cnmnAit; or.s  or'' 

y'isg-T'>sttons  f-jr  f.-irowK-oVs,  T-.e  report  sn-v'-ld  eon--nln  co^.-e’-ts  - 
or  rccon.'W'ndRtion.s  ir.  reparc  t;  rlars  for  Insto.latlan,  omr-ation 
and  rairtor.vncc,  w?.-ch  Kill  ''-.fi-^'nce  the  reHar'iHly  ir.  areratian. 


in  TolXoii'jtr  toe  rraeedure-;  aw!  recorrir/istior^s  o'  the  Tas'  ‘iryT-.a 
oT  t  ’.ere  will  're  3  r-rorresrive  refsne-s'r.t  vf  toe  de- 

.rree  of  a-'-s-rv-r"  ttot  toe  .-•’li.ibilit.y  of  c-'',-t'.rr.er.t  v  1  *<■  Unawn  . 
before  '  ro-J';'*' '  ■•r  etorto.  's-.-re  sr.-o-^id  If  a  r.ir'r.  dern-*-  0' 
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Mavanee  that  M|ul|aiaAt  aan  ba  fraduea^  Ifeat  yill  t>a«b  tli»  Oftr.%- 
tianal  and  rellibiXitv  raiisirenants.  Urn  ardarly  aoalyala  wf  'Jb* 
r-nblen  and  atodr  of  tha  xv^atovamta*  eank^itatlMa 

with  narta  nanufaeti^rara  in  raitard  to  tfaa  nUablUty  af  tto  |>arto 
thay  ranifactor««  and  a  careful  eansidarattaa  of  tha  apvlieatleii 
of  pa'*t3  in  thi  -circuitry  and  emrininent*  be  beliava,  WiU  be 
resronaibla  for  a  (n  at  inr>»itenrnt  to  reUability.  tba  analyaia 
baaed  upon  parta  faHura  rates  will  also  auat.  up  the  weA  areas 
of  the  desif^i. 

The  conpohani  reliability  {ToUan-en'diaBtaea  tba  naed  fo:  aha 
nllitary  afeneics  to  cooxdinite  test  TC^stoKenta  tbat  will  assure 
daaien  ensinaers  of  the  type  of  tofonatlon  they  require. 

miatt  parts  reliabilities  .are  that  are  orders  of  bagnio 

tude  {Teater  than  failure  rates  on  rrrt*  to  souieeie'ni  to  «s«  or 
that  obtaitad  thrau^  life  tests  on  existing  squipnentou  it  will 
be  ncecasary  to  U*w  into  aecopnt  tbs  aead  for  tine  -and  Konay  to 
.develop  and  erocare.  parts  having  the  toqcired  reliability. 

At  in  the  ease  with  all  new  attenpto  to  create  en  orderly  paoo 
eodttts.  thiera  will  ba  doubts  to  regard  to  toe  validity  of  the  ii>> 
formtiott  available  and  twthapa  to  tbe  Stolityof  a  contredtor's 
engineers  to  obtain  adequate  tofpmatioe*  la  tine,  mre  edeqneto 
infonaation  will  beeone  available  j  and  the  eatiaated  raliafeilitgr 
of  equipment,  during  the  design  stage,  will  becone  sufficiently 
accurate  to  remit  the.  etliteiy  depertaenta  to  plan  prograaa  baaad  . 
v.pon  the  uae  of  tba  aquipnent;  with  theieqsirad  deipee-of  eertoto* 
tjr  of  aucMsa. 

taking  into  aeeoent  tha  abora  faetorsu  an'rarasnend  that  )he  aUi* 
tary  services  adopt  the  procedure  with  the  reellsatisn  that  the 
predictions  at  the  end  of  tbsso  I  toouM  be  used  with  the  «hder»' 
standing  that  too  conelualon  reached  is  ia  toe  nature  ot  aa  *edn> 
ested”  guess  of  the  pr^bility  of  toe  systoa  or  equlpnent  -pc^ 
posed  oieeting  the  specifications.  Tee  aeearaey  of  prediction  will 
inprove  as-  nore  data  beco«s  availjftle  for  the  use  of  des'rn  eiK  ' . 
gineers.  In  tire  the  desipn  of  eleetronte  sqat;«ent  will  be  based 
on  date  obtained  fma  handbooks  aa  la  toe  ease  in  other  brtntoea 
of  engineering.  Until  the  data  on  parts  and  teebniquee  is  gensrally 
available,  eegtoeering  departaenta  ef  eXactronie  waiiufaeturers  will, 
iw  doubt,  eolleet  and  organixe  tofomatien  in  convenient  fom  for 
ihplr  ouo  use. 

Tboso  interested  to  a  genaral  discussion  of  tha  "Elanents  of  ha* 
liability  Prediction*  will  ba  totoraatod  to  reading  ASCiC  Kono*' 
graph  Ko.  2i  (IICbar>6b506)* 
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SieUen  1 

SOOFE  MID  OEFn:iT:<M 


1.1  SOOPS 


•  i  I 

.‘  k.- 1 


This  Is  a  proesdur*  fv  th»  d«y«lo'tnent  and  Atsir^  af  a<{Uiirant 
to  insure  required  inherent  rallatlltty.  :  '  '' 

i.s  tsmmm  '  ■  *  *mV-  ’  '  . 

.  •  ‘  *  *  >  •  "  r 

This  eroeedura  it  to  be  applied  sneeiflealljr  to  tiie  dtvelerwni 
’<iAd  desittn  of  all  elsetnnia  equipment,  iihetlter  for  use  in  ainfhft. 
ehipboa'.'d.  ground,  or  otner  cate^rloa  of  speeial  use  and/or  expend^ 
bility.  .  .  ,.  ■■ 

*  '  '  *  '  •  . 

1,3 .  31,-SaiAL  03VSID£?JiTHMB  '  ;  .  '  .  .**'’ 

1.3.1  the  design  of  equitmnt  tiiat  viU  ralve  a  tpeeified  r^iabUl^  ' 
is  a  syster.s  engljwerlnc  nrobles.  This  procedure  is  iased  onvorbing-  ' 
tack  frsn  the  cvorei.1  functional  and  reliability  reqoirenents  of  Va$- 
•qaifrent  to  crorie'e  an  undarstendlnB  of  the  rrobler*  ifsrolved  in  aeeod»  -  • 
plishing  tiie  required  perforunee.  In  the  deeeloiner.t  stapes.‘an-.estl« '  • 
nate  of  the  ^ance  of  success  Is  esMntiei  at*' the  tins  tentatiya^deiiiists 
are  being  eveluated,  Tue  performnee  cf  the  syste'.  or  equipnent*  .-■.  ' 

■  f one ti oral  and  Priiabllity^^isa,  siiall  be  specific  in  the  wntrtet, 

The  reliability  shall  fcu  apeelfled  in  terns  of  cqui;!**;}.  failure  retie,  '  •• 
rrotaVillty  of  axirvival  for  a  specif  iod  length  of  ti”*  under  a  set  of 
spec  if  le  emrlromental  conditions,  or  other  quantitatiTe  ex^ssion.  •  *  j 

,  .V  - 

1.3.?  The  contractor  nust  obtain  an  tndhrstar.d/nr  of  the  fs*«tion  .  ’ 
to  ,be  f^rfomed  by  .the  equlrwert,  the  envlr-ojtient  in  vnic.h  the  f'sietion 
rrust  be.  perfirr.ed,  t'.e  ca'pabiltty  of  toeiO'erstirv*  'ersjmei^  and  htnan 
enpifiecring  factors  that  nurt  be  considered  to  '■rsviJe  far  tr.e  fiost 
effective  use  of  tiie  equiprwnt.  It  requires  the  ecrtractor  to  tice’ 
into  account  Vie  nainttimbllity  of  the  ejui.noent  and  to  clan  the  desipas* 

30  that  tl-e  lo.ht  fro-  oreration  due  to  ra|nlcr*.-.ec  vill  be  a  uinir.ua, 
i*fher.  cquiprvnt  ;s  ieinp  develorcd  that  la  s  vgrt  of  a  ca-eiete'.systen, 
there  .should  be  an  oxcisnce  of  infornstlor.  that  viU  alisH  trado-eff  ' 
studies  to  be  -ade  rel^tlnp  both  Inherent  and  fse  .Heiiabtlity  of  different ' 
syston  confinsr.itions  to  systen  veippt,  raintenar.ee  ti-o,  rhintetuuiee 
nrojedure,  groxuid  support  equiment  required,  ar<i  other' factors  that 
.ufoul  tr.e  performance,  reliability  and  cost  of  t.be  oorpiete  systen, 

1,3.3  The  dereloprent  procedure  consists  of  two  basic  plaises. 

Phase  I  is  a  .'‘e.hsibiilty  study  to  be  teiriinathd  by  a  re-  ort,  as  called 
for  in  iar.'.*.'’  -h  3.1.^.  Ttie  renert  will  be  used  to  eraluate  the  con¬ 
tractor's  u.'>'er«t*-/'4p.'»  of  the  -r^blr-hs  a.hd  thc  rrsbability  of  an 
equipnent  bfeing  .-ieTclored  that  will  ncet  the  •oilitar:.’  ce  artr-ents* 
desired  rerf o.—ance,  irelusiinr  reliability,  nainthinabxiit",  etc.  Phase 


' ,  -j; 


y 


as  ■ 


I'm'*-*,?-  ,’1  - 


n  relates  te  ttw  deal^Tk*  esMteV6.ti«n  fnd  evelnktesn  of  too  pntet^ 
nodel.  This  ofoeedure  will  assist,  in  rwtentlsh  ®f  pngnm  <tslvi  • 
that  woiiia  result  If  an  imlerstendin^'af  tee  prebleii  oii^  the  ciobebilit^'A^^t-i 
of  aucee3sful'c3npli.teee  wite  tiie  desired  rellebllit}'  w^  net  ainelysed 
at  the  fcecinnlBS  of  ,teo  prsftfeo*  ■  ‘  ?^i 

l.h  ■  ?5ras  OF  EOWIRKEHT  AfTSSTED  .  '  ,  ’  v  V*;;. 

1.11.1  AinC-^AFr  EOUIfMnNT.  Jrobebllity  of  •isslon-eeeonpllahaeat  .  f-J 
is  UiS  most  terorttnt  co»isWeratlon  for  sirbome  oleetionte  etjulptient*  l/,  . 
.U'orrnlly' tete  tyre  of  equimer.t  ib  chsraettrlsed  bvdesi^  features  .1 
w.-.ieo  ruke  It  possible  throuAh- checks  idjleh  can  be  nade.perisdleaUjr 

jr  before  tako-aff  te  deternJne  that  the,  equlpsenl'ls'  In  notKal.  esndi»  .  # 
tion  .ird  that  there  Is  a  hlf^i  degree  of  assuraiice  thst„4t>«  eentipnent  Je 
cat.ible  of  rerfow-lng  In  acconlance  with  tlie  .specif ioatlsn'  or  contrite^  ’ 
rcquirorant.'  Slpnificant  requirenents  for  airborne  equipKi^'ere  ’  '.'rTp® 
r.lnL-.m  of  ttoe  te  rrepare  the  aircraft  .for  tiw  nissioiM  and 'for  pro- 
.  fli'tit  functional  test  and  servleo  teat  vlU  ir.3uro  a  sueeaissA>^  ntSSlsn*;A%; 

*  *  _/  *“*  ...  ‘ 

i.Ji.2  G»n<p  AVT>  SHIPSOAM)  A-iow  ifeiittre  rate  ow.  .  .  lim 

a  lor.'»  rerlod  of  ttee  is  the'-trlne  eonsiderati'on  in  ground  and  .shlnteMjd,., 
ecri*rfwr.t»  This  t;*^  of  equipnont  is  nomalljr  characterised  .t^  deaigd; 
features  wijicli  result  in  an  ease  an<*  speed' of  rjintefience  'Kite  tl»  nlni-'- 
rwn-rrqair«ncnts  for  oktlied  rttlntenence  pprsopael,'  ,  ' 

I.!:.!  >rf.c:Ai,  Qiaan  EQuii^im  R»  awittijip  isrtrsMW^  aifjOjf  ij.'M 
con-le.t  (froR  tee  standpoint  sf  jttwlers  of  aorta}  equipoent*  Mtii  $»  *  - 
,  eocivutero  and  large  eor.pler  systens,,  require  .ultra-eonserwiitive  cirri’-  ,  (ilg: 

'  c>.o%-r.  In  UrruTof  parts  applicotion  and  ■a^  require  controlled  cmdifteo*, 

'^.'nts  in  order  te  Rcet  a  high  operational  rel  Ubllity..f«  eqittlnu^.'  ■  i' 
or-erstian  o#cr  extended  nerlods,’-  .  '  •  '  >  ■>  ,.?S' 

‘  '  If 

•  l.Jj.l  te’JMEAHiTf  OF  E3UIi?C?ir.  Sooe  operatlonal/re^lrenento  calf 
only  be  net  by  oqulpnent  which  is  cxtrenely  srall,  lltiit  .weidit  and  idil<di*,‘{^r 
'  an  result,  nay  have  a’  reduced  inherent  reliability*  'tbea  two  or  aw* 
such  aquipnents  are  te  be  used  opt-rstlonally  in  a  redundant  nani^r,  tho  - 
evaluation  of  their  uperationai  effecUvwness  .is  detemlned  .by  thd  relti  ' 

.lb  ill  ties  of  the  several  oqulpaents  of  systens  instead  of  the  single , 
unit.  ■  '  .  •  ■  ■  ■'  ■  ;  .‘/.i?: 

..  .  h  ■  •• 

i,$  psFiifmofi?  ••  ■  ,  • . 

•  •  •  .  .  .  ■■■ 

For  tee  purpose  of  this  procedure,  .'the  foUswinp  d»f irJLtlops  /' . 

sl;4ll  apply*  ^  ..  .  ’.i 

1.5.1  OFE.WJOf:At  nEtXABltrn  -  Bj,  Operational  HellablHty  U  \ 

the  riubability  teat  tee.sj-sten  will  jrive  sreelfled  perforaance -for  a,  'if  - 
siv>;n  pfrisl  of  tioe  whan  used  in  the  Biinrer  and  for  the  curpoSe  in-* 

V:::e.',  It  consists  of  the  Inhorent  ErjUiiricnt  Hcliabllity  as  degraded 

by  v5’*;ous  .'.rplication  factors  peculiar  to  eaui'.  tartipular  field  .»or.- 
•r.tio.'i  (Vse  .^.cllabiiity),  T.ho  Operational  .'eiiability  is  thus  peculiar 
to  ir^iridital  sltu-itlons  .arw  is  not  u  rseasura  of  Irlicrent  Equipment 
'eii-.bility*  .t.s  the  conditions  of  use  aprroacn  those  under  which  the  ■ 

Inncrent  Fquipr.ent  “teliobility  was  rK;a.-iureri  and  as-tee  operation  end 
■  -0  rirso  .’•''roac.  tee  ovality  of  teat  provided  during  the  factory 
ev-J-itlon,  teen  tec  Jt'eralional  Beli.obility  wilt.  a(..nach  the  Inherent 
r.aui!'»’<'nt  Bcli.oS.ilitv.  ' 


"■3 

'  "5  < 


IV; 


l.f«?  VSS  S,lttXi^rr  -  a-.  ■  Use  n^lUSliity  U  the 
af  e'aA*i  at  tnaae  furctiaas  s>nn  ir.  Kijiire  1  *arrl«i‘s 

out,  pcrfamiae,  »r  af:'<Ietifi#-  perfansance  in  the,>s*iw«r  tixaiti* 


1.5.3  Kcs:;.ts;s:? 


PeliabiUty  la  the  rrabal: 
v4:cn  operate.^  anaer  cartr, 
lx:n:‘  3u;';orUn£r  eqai^ac-/ 
rc^ialdllty  Li  rseajure."  r; 
apc'ato'i  undc-r  s;x-eijfic.5  : 
fallaro  rate  t'iat  '.s  ar'rr 
'..•'Iti-.U;.*  Liph  ra 

"ILitnateU,  raila-'-j'.*  V. 
the  equiprent  cx!‘.ii-its  a  ; 
a-'-us's  •Men  tie  rar.ilL;' . 
.  liatteries,  etc.,  start  ia 


3::*M  aEi-IAPliirr  -  a,;  Inierent  Squiswet 
■iiity  af  tie  equiptseit  perfarelftt 
■.•..'tviliy  statOu  aitritiar^  ear.ditia*K:>  -tLL* 
;t  and  -raeCi^u:vs  ir.  tse-  .-^i  i.er  inter3<:i,  the 
•yt-ve  faUia-c  rate  at  lac  equivocal  aiHe. 
aarditiasw  far  safficier.t  tt*  ta  altalr  » 
-xL-.'ti'i;-  eann;.-!/,.  LsaaUi*  Uu’j'e  Is  ^ 
ta  '.rlad  duriar  vr.ir,;  Tcrj'iaal' parts  ars 
la,  V.ei'e  is  *r.  ;«ria4  duriac!  Jc.rh 

iairl;.-  «:^stanl  failure  ra<e.  A  fiaal  j-iriari 
a.-.art-ltff  iirts,  staii  as  letAxlne  iarts,  .' 

I  wear  out. 


l.J.li  SVatT',  A  a^-star;  Is  defined  *s  eap  csaJlnatiaa  of  ^fs-Lete 
'>;'eratir."’cquii'rer.t,  ea-.pater.ts,  acecssorids,  or  parts  so  intersC'ssrteted 
or  Inlcwlatcd  inauah.a  na.ut;r  as  w>  *  3r>jclfic  opera tloeal.  , 

function  or  funetiorj.  /  ;  • 

1.5.5  javrLfTs  omcr*'.  ttcintn;?.  a  c-a-.pii«te  oterat*^  ■ 

ficnt  la  .iefincd  as  an  e5-irt;vrt  topetiior  vita  tie  iwcessar;*  ’tens,  _ 
aecesaorios,  and  corp-or.T.tc,  or  any  confc-inatioa  tiereof,'  required  for  - 
tiie  scrfontance  of  a  aracifi^i  fj*«tion»  '  . 

1.5.6  K":L’:KSr7.  An  equirnent  shall  w.aist  of  on#  or  feo** 
conpononts  capable  of  :«rfor5ir.j  spcelfj^ed  functior^.  , 

■  1.0,7  '  ca  A  (ssspoiwnt.  Is  defined ’as  an  article  vhieh' 

Is  pomally  a  I'snbination  of  parts,  sut'^esse-.biifs;  or  assert*#*. 
and  is  a  self-contained  ele-*;.-.'.  jf  a  eonj  ict*  areratlnp  eduipnetjTtt;™, 
peefoms  a  function  »ejcssary.t}  the  operation  of  tiiat  equiiw.it. 
txa»  li!S»' Lndi-ator  unit,  rover  unit,  recoi-.rr,  tr.mo sitter- twilnp 
units,  rotitia*  antenna,  s>iulatjf  ajut,  napllfler  unit,  .etc. 


boxes,  etc. 

i.5»9  FAHT.  A  rirt  is  defi.’rd  as  an  artiole  -.Ciich  is  an  elerxst 
of  a  3Ub-aS3eri’'ly,  ar  »..  assc-lly,  a-^  i*  of  sue;,  construct  i  on  ti.et  it 
is  aot  practically  or  cej.-.a-i.-tlly  ani'ss.'ii'lc  to  f'^tner  <<’3a5afhly  fer 
rainlenar.cc  pur'orc'..’  Tx- — I- .-t  resistor,  fo-/...t  tusiii'.*,  fined 
cajMCitor,  tr.aiisfomer,  tleotrrn  lute,  rolrp.-,  ;'ate''tio.-.;tor,  svjtc.;, 
conrector,  socAct,  r;..-*’'.-. ,  etc, 

r-'Ctior.  2 


A;rL:.vr.y,  u,xr.:;.td 


i  ■  Section  J  V 

!aoLnna»  KvaomiNT  taaoE^ 

,  34  kwsr  X  -  sTtfs  *a  riA!3TO 

3.I4I  flSViav  OF  HS^rinaCMIS.  a  review  slukll  b«  :%do  oT  ^tstCA 
and  equipnent  .requirK-.^nts  establish  an  aeem*ate  picture  of  'all 
the  para-ietors  w<iisK  siy  effect  its  rerfsi'nh"‘Cc.  Special  attention 
shall  be  civen  to  orcratisnai  envlDmcnto  of  t:»e  «qulf«jnt,  quailflca* 
tlons  and  duties  of  the  oreratlnc  perjonne.i,  naintenance  procedure* 
ami  storepo  and  handlln;:  conditions  .Involved  in  the  ♦renspoftations. 
Installation  and  ape.ratior.  In  actual  sen'lee.  Ihla  revtcy  nay.  require 
discussions  with  oi’cratlonal  personnel  and  systens^enfineerlnn*  ii* 
stflUatian.and  nalntarAhce  croups.  2t.:nay  also  require  a  study  qf 
eonnarable  cquirt<ent«  and  visits  to  aetlyities  havlnf,  conparsble. 
installstlon*.  •  .  ^ 

3.1.2  ESTABUS:;yr.-T  OF  rTprXJin)  pFSlffi!.  Deelaior.  shall!  be  ,  ; 

.  nade  on  nothods  of  probleh  solutiosu  fib.'iinationa  of  e.cetrlcal,  *- 

eleotrohic,  eieebnnicai*  ajdraulie,  ^.-id  pntunatic  syetens  ray  b*  used. 
Optlnun  levels  of  sL’nals  shall  be  established  for  converting  tron 
one  syiten  to  another.  Hanual  versus  autanatic  control  netnxla* 

Sliced  of  dreratioh*  rrs.^iaa,.!!.,-,-  .'.id  oti'.cr  such-  faetff*  shall  ba 
evaluated  fur  reliable,  operation  with  respect  to  the  requirdd  nultl-  - 
I-lielty  of  comnonent  iNirlo  and  circuits..  ..n  intense  effort  sladl  be- 
node  to  sinpllfy  the  conirrent  in  everj  wai'  practical.  Modified  pei'» 
fon^ance  raquJrenenia  s.iall  be  reeoVr.ended  if  an  analysis  indicated  ■ 

■  that  Uiere  is  no  practical  ViU’  to  acet  the  reliability  if  specified 
performrice  is  fully  conpll'^  with,  or  it  slirht  eh.anfcs  would  result 
in  tc'tt.er  reliability,  easier  naintenance  or  less  costly ’etjuiinent.  . 

3.1.3  ESTITiAfiO::  OF  The  areas  of^isc  Reliability 

shall  be  taken  into  account  in  the  rlenning  of  features  of  the  dcsitfi 
to  nininise  the  reductisn  ox  Operational  Reliability  due  to  Umsc 
.^ircas.  The  contractor  should  nake  an  estimte  of' the  dsf^fedation  of 
the  Inherent  Equipoer.t  iWiiability  to  be  contributed  by  the  factors 
Involved  In  the  use  of  the  equipauht.  Tnis  analysis  Shall  be  included 
in  the  report  required  by  Farafrrarh  3.1.Il.  ■ 

3.1,3,1  Operatlorjl  Reliability,  "Tne  product  of  tfii  Use  Relia¬ 
bility  .and  Inherent  Sauirr-int  hellEbllity  will  establish  the  required 
Operatior.31  RellaVility  -  Rx.  It  should  be  noted  toat  some  of  the 
areas  under  Rj  arc  Hv  are  independent  of  each  other.  Otiier  areas 
can  influence  the  numerical  values  of  eac!i  otiier.  The  nunerieal  value 
of  Ri  wiXl  al«.o:.-5  he  less  than  tiuit  of  Rj  or  Ro,  unless  cither  fig  or  . 
Rj  js  loa,:.  in  iihlcn  case  'ii  vxll  be  equal  to  toe  ether.  At  all  other 
tines,  .however,  Rj^-will  be  less  tiian  Rj  or  R^. 


^  S»I Utility.  d»t*  1«  %M£Ubl« 

far  rafaranct  JfwTIettrltTo  hariir  ixullxtism  af  ainUwr 
mnt  uMer  ainilar  eanditianst  ji  Will  (»'*asu7  ta  s>ctf  «  *’^st  - 
pjess"  estinntian  sf,  £t  least,  114*  ite^  iaHa^ted  unler  t'se  F^lla*  ’ 
bility  -  Rj  (Sae  Firure  1),  Such  •  ’^st  raass*  estlnate  afiall  ean- 
slder  carefully  ihe  effect  of  each  it«tt  js  th*  -rahability  tAit  trtt 
sapwrt  piven  ta  the  eoaipnent  will  be  as  pla-  oed.  Careful  caasiOcra- 
tlan  of  each  of  these  iiens  *n  the  deslrs  cf  tie  eculrnent  is  essen* 
tial,  the  abjective  beir.R  a  desipn  that  t*  a*st  tolerant  of  >i:^ianasd 
eundltions.  Inprote^^nt  'a  Use  Rollability  aust  cafse  fran  a  stu4jr  of 
each  of  the  fsetors  affecting  Use  Reliability  and  its  effect  oa  tha 
others. 

3.1. 3.3  Inherent  Eculment  Rellabiltty.  A  catefUl  etady  alull  .  ' 

be  made  of  the  enti  /unction  of'  "the  ciycitrient,  installation  and  naiiw 
teronco  problcns,  also  other  csnrlderstions  ?s  inJieited  under  figure  1 
to  rietemino  the  ninber  of  oonponents  into  mlch  toe  equipaer.t  should  ■  • 
be  divided.  .  . 

After  a  tar.tatiw  design  of  the  s:rsten  or  et^ifeent  has  been 
prepared  ttiat  will  be  capable  of  i4eetir.f  tie  perfaraanee  /^ulrMnts 
including  the  ft:action  to  be  performed,  arerationoi  ehuuteterisUcs, 
provision  for  rtaintenar.ee,  etcl,  an  analysis  shall  be  rade  to  deter^ 
nine  tire  reliability  requli'eraentn  for  e.tsr.  sf  toe  cosrorients  ttrd  part* 
in  order  for  the  sj-steo  or' equlpnent  to  meet  the  specified  reliabtli^.  - 

If  the  design  is  one  in  Miiph  cU  of  ts«  msponents  and  pert*  «r« 
vital  to  Ure  operation  so  that  the  failure  of  any  one  will  cause  equip* 
ner.t  to  nalfunction,  the  followlnp  nrocecirw  say  be  espls3a*d,'  This, 
procedure  c»n  be  followed  first  ta  detemiae-  esnronents  reliability 
requlrenents  and  then  tr.e  canponents  can  be  anelyted  to,  deteroine  the 
reliability  roquireaerrts  of  the  individual  pert*.  . 

‘  '  *.  ^ 

3,l,3,Ij  Coapsne.-.t  Analysis.  An  aiwlysis  of  the  proposed  design  '• 
for  a  system  or  eVcirrerrt' stall  be  nade  thit  will  indl«te  the  allowabla 
failure  rate  of  cor.ronents..  If  all  t!:t  csTConer.ts  haw  equal  resrocsi- 
bility  for  suecesrfui  operation  of  the  systeet  or  equipn*r,t,  the  inherent 
failure  contribution  ca.n  be  divided  ai»np  ice  conponents.  If  sons  ; 
components  are  inherently  capable  of  preaUr  reliability' than  others  •• 
due  to  fever  parts  or  parts  that  are  core  reliable,  the  allowable 
failure  rate  allocation  can  be  nodifled  aorordiraly,  ^e  eonronant 
reliability  allocation  is  an  essential  par*,  of  the  systee  or  equipaent 
iesipn.  The  allovcble  failure  rates  for  coapene-.ts  can  be’ adjusted 
in  accordance  wivh  data  obtained  in  rerard.  t-o  failure -rates  of  part* 
eorten.clatcd  to  be  used,  so  lonp  ao  the  total  fatl-jres  per  hour  ar* 
wit.hin  ttift  iVrnissible  lir.its,  Tne  anatyvij  i#  tased  on.tr.e.asjurp* 
tior.  that  tlie  failure  rate  is  in  its  porioi  sf  teirur  nearly  constant 
and  flat  the  ralntien  of  (reliability),  or  r  (failure  rate)  and 
a  (■c-an-tino-to-failure)  are  given  by  tne  irrrcla  - 

'*3  •  P  -i  ■  » 

Assune,  for  exanpie,  a  cj~ror,er.t  is  require;  to  taw  rean-twe-W-’ 
failure  of  jOC'O  hours.  r„  s  I'^ix)  hours  -etn-tine-to-failure  (n)  aay 
be  stated  as  a  co.-.rior«-.t  failure  rate  per  bNir  ,r', 

>*  2  1  or  1  in  this  case,  tlms  r  *  .,V1  sr  ,^1 

n  ICOO 

iMC  per  nillion  hour?. 

£1> 


e 


per  ho'cr  or 


Wgur#  I 
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A  stellar  t^roesdura,  In  ium^  will  Indlest*  the  allowstils  fallur* 
»«te*  for  parts  used  Iji  the  rarlous  eoRpsnsnto  is  neei  itis  speel^l*^ 
reliability  required  for  that  eonponent  in  th»  systen  or  squiptenik 

To  deteiwtm  the  alloMabU  parts  failure  rate>  the  parts  used 
.should  be  elassifieo  fay  type  or  eetegoty  and  Jts  quantity  of  stdi 
detenined: 

nj^  _  units  of  part  type  or  eategary  1. 
na  '2 

’  ‘  *  J 


tip  units  of  pert  type  or  eategory  'p 

The  actual  number  of  parts  of  each  ^ps  uhidi  go  into  the  oonpODefit 
should  be  listedt 


r  (eonponent)  •  nin.  *  ngrg  a  njrj  a  .  »  *  nprp  ■  '1/ 

lAere 

rif  Tit  r^  sre  pert  failure  rates  and  ni,  ns  »  *  •  np  sre  the  qusntl>  ' 
ties  of  each.' 

The  sun  of  ths  (nir*  e  *—  >  t  fsilures  of  all  parts 

nust  not  exceed  the  allr^able  for  the  conporiont.  ■  The  sun  of  the-  ' 
failures  of  all  corponents  nust  not  exceed  that  allovstle  for  -Uis 
e^^ulpnont. 

failure  rate  Infomation  'on  parts  should  be  obtained  from  the  ■ 
."Ar.ufacturers  of  parts,  ro'.-ertror,%,  and  otaar  availabJe  sources.  In 
eiooo.  chore  the  infom-ition  is  not  available,  it  will  be  necessary  to 
•ieterr.lne  the  capability  of  parts  nanufatturex's  to  develop  parte  end 
ra*-.',-  the  neccssvT  tests  to  provide  U'.e  'infotr.ation,  in  recard  to 
fsiluro  rates  to  be  sxsected  under  Krecifie  test  conditions,  Vben- 
reooooarj-  bo  obtain  failure  rate  ini’ormtion  through  life  teat,  lae 
iife  test  ■vi.oald  be  continued  f-or  s  sufficient  lencth  of  ttoe  for 
significant  quantities  of  parts  to  attain  s  fairly  constant  failure 
rate.  Failure  rate  'hforaation  obtained  on  parts  in  conparabls  ' 
equl'r-.er.t,  as  has  bet-n  ex-erienced  in  act-sal  u-oe,  should.  b<t  considered. 
If  tne  required  failure  rates  are  cor.petihle  with  actual  experienced 
fail-^re  rates,  pood  circuit  ar,d  oquj.rrent  desipn  should  result  in  high 
rr-'-^cblJity  tiist  the  specification  will  be  net. 


ahauld  b*  llst«4  tw  fpteltiff'titUttrs  r«t»' 
•Mlysis.  ?tMM  shottU  Inelud*  iMt  not  bo  linitod  to  tho.foUwinct 


Tvtma 

^^gnetrono 

Resistors 

Corteitors 

CjTsUls,  diodes 

Cyras 

Clut^es 

CynchTM 

Transistors 


Poienitowtsnt 

Kotom 

Stfltidws 

Transfomors 

Miero'swltches 

Connectors*  sodtets 

Gears*  drirs  bands  ^ 

HlseoUsneous* 


"«  »«>» » . 

^  i^sporsilUlty  to  deraU  the  Mrt*'- 

»  fat  t}»  failure  rate  woutred  CiSTb?  - 
cireu’t  Interaewi^r’**^*  'til  ^  neceaaaiy  to  take  Into  a.sciMint 
Lwh  ^  by  changes  in  raluss  of 

=ir£l9>"-^SM  r*.iu  ; 

lent  «li*Wllty  Jo  not  probable  of  ettsln-  ' 

be  rodLceJ  l«.,erle,  nust  ,,  . 


1-).  lazi  of  afcr  hij*  reliability  iiarts. 


will  eot?pensatt 


rcdtwJaney  nethods  is  to  desim  equipnent  to. 
snttoiaetorijy  in  spite  of  failure  of  certain  crit^l  oarta 

.ff  SS' , 

Vie  ''csir^/)  vf*'  ^^-Axysls  ;f  i„«  tentative  that  • 

-  v<'r-,-  vac^al  in'^ofct.i'r.-'* ^tnen.isc  be  -let.  :icdundancy  Kay  be 
■-^r  ■•iub!ni:!wuro  teAnL reliobUity  When  usir?  si^ictare' 
^os---,  ®  ^  ntninise  sLzo  and  wei-^it.  The  rosultlnr 

'*"5  .*1  15  a..cn£ifcl®  t^  tsic  suie  !•  *• «.  %.  .  ** 

ssivssstjra!:.:- 

***  Mtcror;-' which  is  introduced 
jww  cesli-n  and  o;ner  electrical,  npciuwUal,  or  electronic 

JO  M3,  I«.ic-..msii.. ,  eta;,  er.;  roxl-ai,  ly  ?•)  per  cent  jf  the 

If ‘tiff  1  ^»^~orio3  of  r-jrts  listed  above 

j,-  a,_OKet.  for  tieje  nlscellatieous  ite.-is. 
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report  to  tho  epeney  eoneen»tf«  vtoldt  shell  ehw  whet  pro*  - 

rialsns  are  being  node  to  insure  that  the  e^lpnent  will  be  suiteble 
for  operational  uset  that  proviaions  for  its  naintemnee  niU  be 
adequate  in  the  eonte;:plated  ewinment,  that  it  will  perfom  tbs 
function  in  accordance  with  the  specification,  and  the  estUiated 
probability  of  the  equipment  neetinj:  tiie  specified  operational  rella* 
bility.  The  report  shall  includes 

(a)  Caloilatiopa  and  date  that  has  been  used  to  estimte 
the  use  Reiiabillty. 

'(b)  Sescription  of  Case  of  Kaintsnanee  features  to  be  ’ ' 
Inci'jded  to  r.eet  toe  naintalnablll^  requlreoent* 

(c)  .Calculated  reliability  reqidrwcnt  for  all  parts  and 
'  coaron«!t.8  by  caterorlbs  .or  types  required  to  neet 

Uie  necessary  li^ierent  nellabiiity.  Include  all 
data  available  repardinp  failtrc  rate  of  parts  con- 
te.”iplated  to  be  used. 

(d)  The  reason  for  anticipated  parts  and  caisponent  failure 
rates  tr.at  arc  Icwor  f,.an  failure  rate  data  based  oh 

.  experience. with  'eriatin^r  equipnents.  ; 

(e)  HeeorrrJwJation  of  t'.c  contrastor  in  regard  to  nodi-  ■ 
fieatlons  of  Wse  req'uirtntnts  that  nay  appear  to  lx 

-  escor.tial  in  order  that  platuied  selicdules  and  allo.^  ■ . 
able  costs  can  be  r.at» 

(f )  aecsrinendations-  of  lhe*coi»trae1or  recardinj  changes 
in  rant  Irene;-, ts  needed  to  effect  siTvilcation  in 
oquipient,  i;,s  relation  to  the  relialllily  requlre- 
■:'.cnt,  wclcit,  space,  and  cost. 

'  #  •  * 

Or.  the  basis  of  this  analysis  and  report  the  nilitarj-  a/xsicy  nay 
decide- to  jroceed  wit-s  t:ic  development  or  to  <S«ri:e  certain  require- 
nents  in  order  to  neet  the  required  reiiatiljty.  The  purpose  of  this 
F;'.aso  1  analp'sls  and  rerort  is  to  nroride  tiie  infom-.tioit.  iieedcd  to 
assess  'the  risk  related  to  the  tot-sl  sjeclrication  rcquirer/ir.ts. 
iicf-ort  procecditc  into  'iasr  II  li.ero  should  b«  apreq;".ent  between  the 
r.ilitaty-  a.’er.c.'cs  acU  ti.n  contractor  t-iat  tix  final  s feci fi cation' ar-d 
require.-.ent  LncludU^p  reli.-jbility  are  achievable  a'.id  have -a  nich 
prob.-it-U.ity  of  tvlnc  net  in  prodaetlon, 

>.2  BtilST  IT  -  r.ESIG?f  IJtX  C3:,STri!.Cn,aJ  OF  noTOTire 

0.2.1  HTOEW  0?  rC3i.",’  STUDY.  Sised  an  tie  requirericnts  deter-- 
istocd  durini:  the  Phase  I  st'idy  for-sice,  wet^t,  f'ucctional  perfonuineo, 
sr.virsr.'v.nt,  suitability  for  operation,  eaintenarce  provisions  to  rest 
EOF.cifled  repair  en-1  c.“ee!c»out  tiac,  and  r-caas  t,  rravide  part  enviror-* 
r.erti  u,  obtain  tr.e  nece-ssar:;-  part  reliabtlity,  l;-,e  contractor  s.-iall 
p-'-t-ibiisr.  tie  nu-.-er  and  o.jiracteri.'-.tics  of  the  cor.por.c-r.t  anil  the 
desi.-r  fi-jit-.rrs  to  :c  -osed  in  oaci  ns.it-oncnti 

,'.’0  AH-UdATur:  Of  -OZ.VSijlT.t,  ivery  effort 
shall  be  t-o  seioet  stirrlnrd  cirruits  .n-i  :.arts  which  have  proven 
tr*  ix  r«bi.-.M6  «;.-l  tor  waich  riati  ru.-ard'.nc  lail-are  rates  is  available. 
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It  fUltetJ*  proven  eireulta  eamot  be  tawi,  otitere  my  be  used  Nhoee 
terfrtnanee  le.  bs^ed  on  peraneters  at  the  partir  vtiieh  ere  eontroUed 
by  soeeificeliois.  If  the  perfoncnce  of  vie  only  eireitite  nMeh  will 
function  in  tiie  ifixi'iirti  ranner  in  based  tt;!9n.,ioraRetere  visieh  are 
uncostroliod,  t;ien  srecifie  ar^roval  for  use  of  sueh  eireuits  and 
'  parts  shall  be  obtained  froe  the  cuwrnnent  proeureaent  agnttey  and 
reconrendatiaes  recording  the  control  of  tba  required 'pocaneVer  sitall. 
be  fade*  Critical  cireuitrp*  shall  be  eliminated  by  de3l0t  to  allow 
lar.-te  tolerarice  -ar^ins  in  circuit  operation* 

A  lai^e  nurber  of  eq-jiprjuni  failures  ^  result  fritt.a  di^t  in 
tlic  value  of  critical  part  c‘-aracteri8tl ci*  So.nininlue  tie  effect 
of  drift  with  tine,  circuits  r.ust  be  dasl^«d  tiia't  will  ooerate 
oatlsfactorllc/  be>-onii  tie  Initial  noraal  distribution  (-)  of  the  part 
charaeteristies.  Inverse  feedoaeX  and  sinilar  conpensaTinr' types  of.  ' 
circuit  derirn  sliall  be  applied  v.'.«revcr  they  are  needed-so  that  IWfe 
chances  In  part  ^:araetcristie  iviy  be  tolerated  before  the  nomal  !- 
circuit  function  is  affected, 

3.f.5  SK22?:o;j  OF  PAilK.'  2ver/  effort  shsil  be  node  ia  selee* 
farts  and  materials  fr^  ntlitar;-  preferrsd  and  standard  parts  lists  • 
ao  s;eeirie>i  in  tl:e  contract,  Aten  it  has  been  detemined-thst  ; 

■  required  fiilvre  rate  IrJ'oitiation  on  oarts-and  materials  is  not 
suitably  described  by  existing  nllitoiy  speeifieatlons,  tite  esntraetor- 
shall  'rcsore  suitable  procure.nent  infoi*n3iion*  Tat  contractor  shall 
request  a:'prsval  fro::  tie  trovenr»at  e,tCR:qf  concerned  to  uoe  'such  parts' 
ar.j  subr.it  data  accurately  denonstratlnf  tie  peitfoirnnee,  describini;  ’ 
tec  parts,  t.e  circuit  application,  and  application  enviroments, 

.3.2.J*  saiFcrio?.*  OF  Asaj'cr;  CEsicH  csani;<iuEs,  .  ’  ’  s 

Xalntenanee,  7t)t  tyoe  of  eomtruetiou'a&pted 
.must  perr.il  qiiicie  fault  tocatlon,  'Speed  of  rv'usir,  adaptabilltj’  to 
future  equifwnt  rtotlernization,  and  sust  siapllty  prsblsRS  of  lOniStie  • 
su-'rorti 

(1)  The  niaiber  and  type  of  replaceable  'Sub-asseRbllos  - 
shall-bc*  detemiri^  by  tas  requirenents  for  r;ain> 
tenar.ee  tine  and  skill  of  .-j»lnter.anee  peroonnel 

at  operating  levels,  Uhtrt  (he  eost  of.  supporting  ' 
spares  and  storage  space  for  then  is  a  eritieal' 
criteria,  the  following  nust  be  eonsideredt 

a.  The  muiber  of  tines  the  sub^smbly  is  used  - 
in  the  equifnent, 

b.  Til*  nunber  of  tines  the  suc-esscnbly  Is  used 
in  otacr  cqnlprents  sup.  lied  with  spa^e  parts 
fro'i  tne  asie  location, 

(2)  Allowable  naintenar.ee  tine  will  detens.'ne  require** 
ne»its  for  fa'ilt  indicating  crerlsions  that  Bust  be 
insorpor-ited  in  the  do.sipn.  The  CM.olcxlty  of  the  . 
fault  indtcatlv  crovisio.ns  nay  be  tt>dl.''icd  by  the 
dacisio.o  as  to  the  nusber  of  t'.o  replaceable  su- 
asso-Kblies  used. 

())  The  decision  in  regard  to  the  nunber  of  renlaceabls- 
sut-asoc.'A'lies  to  be  used  r.ust  b?  detereined  by  the 
conpli'xily  of  fault  Indicatlrig.  provisions  with  its 
possible  effect  on  reliabilib', 

■  2Sk 


ArraneeasnU  for  Mreinal  teoting  tcehnlquM  a.r»  %a  \m 
Mittr*  appl  ieable  to  th«'  4^'pe  of  equipaent  toinr  (tepirmd*  Tori^Ml 
tostin;  ohould  bc  enplo>«d  In  eotmeetion  Mlth  digital  equiinent  to. 
incraaae  the  reliability  of  a  systen  during  a  Aission* 

General  Emriroiriental  Conslderatl-Mrist  Certain 
eonoilcrationo  of  ne&t  dissipation^  counting  o/  fir^  for  protection 
from  effects  of  vibration  and  3hoc‘:«  and  protection  of  parts  fron 
effects  of  njiatvre  will  riatcrially  affect  final  assenbly  desisn  - 
teehni<iuc.  Suitable  neans  should  also  be  considered  for  protaeiion 
against  sand,  dust^  altitude,  and  hi'di  gates  of  Change  of  altitiads 
rtien  aprAiOLble. 

><2<h*3  Therral#  'In  the  deeign  of  electronic  e^iuipsent 
for  optinuii  coolinr,  tno  •eat  produced  by  the  n^rU  shell  be  directed 
along  specific  paths  to  4  h^at-sisde.  .Farts' m'icb  generate  heat  shall  ' . 
be.  isolated  froR  rorts  vhlcn  heve  a  failure  rate, 'that  is  affbeted  hy  ' 
heat*  Isola^iorr  nay  be  teconrlSsutH  in. one  or  ndra  cf  the.  following’ 
ways*  •  ■  .  '  ' 

(1)  1?^  parts  «ay  be  rhysically  seperated* 

(2)  T'*  pozdo  tuty  be  IsolaMd  by  neans  of  themal  ■  - 

barriers,  „  '  ; 

•  (3)  ’.here  coolln-  fluid  (liquid  «•  *-88)  is  utilised,  '* 
the  part-o  wsich  ,To<luee  best  nay  be  pla.eed  "down- 
straar."  in  tite.fiow  of  Vic  fluid,  ss  'that  the 
cooler  fluid  Ir  in.tfce  vicinity  of  the  peris  whldt'  ' ' 
‘  sTf  censitivs  to  !»»♦•» 

there  hcet  coriduction  te<d;nistte.'i  art  used,  beat  flow  paths  of  low 
resistance  sboU'be  rovided  to  carry  heat  fron  the  beat>psoduetiig  parts 
to  t-be  heet«sinh.  These  paths  shall  be  as  short  os  possible  and  d* 
suitably  large  cross-sectional  area,  Uiere  heat  convection  is  used, 
it  shall  be  in  suen  a  direction  as  to  aid  the  .natural  eonveetloa 
currents.  Tartieular  attention  should  be  given  'to  tlie  effects,  of 
hiidi  altitude  whe.*;  rertli«rit.  Kdat  dissipetion  techniques  tdileb  are 
effective  at  low  nltitudes  aay  rot  be-  effective  .at  high  altitudes*  . 

T!ie  oorstruetion  sr.all  be  earable  of  vithstandiug  the  stresses  iaposed 
by  tiieinal  shock's  -wi  cycling  to  which  the  equiirwnt  asy  be  expos^* 

3.2,h.t:  Sr.ac’ic  art*.  Tibrstion.  In  the  counting  of  perto 
for  protection  f  as  V.e  effects  of  vibration  and  shock,  the  type-  of 
nouitlng  to  be  used  is  cependent. upon  the  duration,  aaplitude,  and. 
frequency  of  vibration  and  shack  encounterorf,  ' 

Under  condition.''  of  continuous  or  interwittent  vibration  and- 
iipact  shocks  of  lir.ited  a-oplitude,  ratisfcctcry  isolation  nay  bs 
piovi'.ied  for  by  .'ourtLng  equipricnts,  eo-oponents  or  narts  on  shock 
alsorbir*:  no'jnts.  So-i-.l  waves  r.ay  result  in  pert  failures  dependent 
on  the  aap'litude  sr^i  frcToency  of  t..«  rrcs.oure  waves  unlesr  tne  parts 
.arc  adequately  .-rotected. 

Under  canditl-jriS  wncre  fns  cquipnent  is  s’sbjeeted  to  short 
cxrosire',  to  inter-. itte.'^t  vibrattor.  of  variable  -yr  indeteraliiate  fre- 
q'jencles  and  ir!;«ct  s.'.ocks  of  higr.  arplitude,  it  nay  be  l».st  to  mount 
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th*  t%ru  TltUOf  to  tho  tram  at  Hit  «t&lols  la  ordor  to  ovaU  ; 
ronec  cffoeto  ij>  tho  nountlar  stnctoto  t^.t  Mould  ioenoM  tM  ,  : 
KtrHtudo  of  Tibrotisn  to  ^lish  tise  T*rsi  *f»  S'itjoeud.  rofW  r^! 

be  secured  ^  eX:r«*  bndcets,  or  nltebl*  bondiot  to  tbtir  MaBtJns  i 
strucures.  ,  •  ‘  ■  ■  ,  ■ , 

3.?*t>.5  lis  tbo  soto^ion  of  perto  f!pa«  t^  <; 

effects  of  nolsture,  tae  fo^^Umisc  beaie  tecbcl^jes  idioJl  be  eomttendt 

(1)  l^ouatinp  r»yt»  in  suitobie  conUtner*  tdiieb 

ere  hex«etie»liy  setlri.  leads  or.tomiaals  ^  . 
rust  be  suitably  dtsifstd  to  preirent  Kotstiu* 
entrance.  ■  .  .  .  ■  -t  • ' ' 

(?)  SneapsulatlAr  or  eostda;  carts  vith  suitable 

rlastics  Kr.:«:  are  oaxble  of  a:tin|>  as  effee>  -  . 
tiVB  barriers  to  eatrscce  of  aoisture  td^ia  t 

■  the  parts,  i^tis  car  saie  tais  techni^pis 
ineffectite  uK>ss  suitable  creceutions  ajo  ■  '  j. 
ta:-:en.  .  .  /'•,  • 

'  .  '.-‘i 

(3)  bse  of  rater ialjj  Mild,  are  water  repelJaat  in 
naturo  ab-i  lists  Bi£i:tiae  deleterious  effects 
of  aoisture. '  /  ,  -  _  ‘'Jtf,  fj 

lit)  Traride  an  er.TiroJsitrt  ftr  the  equipaent  fras  ^3,  ^}{s- 
wiA  eacess  noisture  sas  teen  rMoied.  "  . •  i  ;, '  c' 

3.J.5  ATfilC^TlOS  .jr  ?iSrs.  farts  sba i.1  be  applied  with  dar'f,, 
•p»!>Ttrd  to  tolennre,  stabilit?,  I'd  er»ir9.Ttsar.al  eonditlsjss  as 
erreretl  by  arrlicofci*  jnectfliatient  arsd  itae* pertinent  application-,  ’ 
irfbrrMtion.  In  this  ?roo*?s*af  atpliraV.sc,  particular  attention  -  '  ' 

S'all'be  riven  to  the-effects  or,  e,5uipi*£t  perfoitutnt*’ of  thejtoUranes 
distribut'-or.  of  the  parts  *v  Vbe  be.-ircinr  and  at  the  end  of  tbo  ‘ 
e<niiff>rRt  life  a.t(i  as  .affected  by  esTirtjtirr.tal  conditions.  Far+s- 

ir  circuits  rucS  t.bit  an  additlofSl  ' 
taiorarn^  c.arKe  to  the  nripitil  part  ‘ci.trar.ee  can  be  tolerated  wilii*  :  - ; 
cr-.t  »’etri.*ictil.-»  r-.snpe  ir.  circ-,iit  -a.-fortar-c*!.  *  fr^e  ragnStade  of  -thio  ,  ■ 

tc>r.Tr.ce  r.ari*in  will  be  de;«n.'.rr.t  o-.  v.c  tyre  Of  part,  the  circuit-  -  t 
ir.  v.'.r.t  it  is  -uied,  end  V«  severity  of  csviromerttal  conditions  S  '* 
to  vnirr.  tije.rcirl  is  exros<st.  .  3  :  .]■  .-. 

3.r-.?.l  P-irt  r-'cr’.ti-’r.--!  EstaMiAetl  ratings  J 

of ‘.•ottarr,  -.«cl-r.ai  vor'-iLv  rciti.nr,  cacratli^  lenprrature,  '  4 

«tc.,  are  all  rose-i  or.  f.-iil-o?  ri>  f.rjns  for  operatio-n  far  sped"- 
f:.?i  tines.  If  th.i.t  fail-ure  rate  firurr  is  .-st  as  low  as  desiredi 
t-.e  part  nay  after,  be  cerates  for  a  .tiper  rs.iabLlity.  derating 
■  j;  x.:e  part  far  louer  fail. re  rate  -uiy  be  or.  the  isisis  of  reduced ''  . 
•.af,a.-~,  rr-hurei  :/or:-:ir,.7  vol-;.jrs,  re-t.reC  oserauihy  Unperature  but 
i'.-o-li  srly  hr  done  after  s.-ins-iitotior.  v.us,  and  apree.ier.t  by,  th.e  . 
rarts  -Arafa-.-furer.  T.-ie  aet.Al  :-f  tes  carts  in  t.'-e  fartieo^ 

Irr  desiT  s.:.»li  be  csrefuliy  4j-'?ii<rei  *c  ass-re  t;.at  rovir^s  • 
o.-.  ration,  shoo't,  terr/erituri,  r.oisture,  etc.,  ore  not  exceeded. 

o.r.6  :'31.-w:"lCAi.  ill.'CV.-.iS.  y:.e  seieetiss  of  suitable  nechaai-  '• 
:ai  str.;t-ircr  l.t  .a-.  !r.te,-r-i  :art  sf  ssieccior.  oV  aseenioly  design 
tes.-j*.i;--ss.  Tr.e  -rive  reoulrenrets  for  i  rood  aeeh.'uiicsl  structure 
are  that  it  be  r-ry-d  cr.ou.u  to  crewsnt  ixaiaje  to  itself  cr  to  Parts 


muntwi  withiB  vr  os  it  Mhen  the  eaaponent  is  subjected  to  its  nonisl 
opesstlonsl  use>  norrrO.  )undXin,t  srd  specified  emdition  of  sbippl^ 
aiti  stomr^.  lx  ssrCd  be  sf  such  s  tjfje  U»s^  replacement  or  repair 
of  cosponents  or  rsaitUr  sub-assenblies  car.  be  r.ide.  within  specified 
doun  ti;».  Cart'  spal^  ;e  ta':cn  ts  .tssure  titat  itrsoiwnee.-j,  .dt»  to 
.  shoe;:  w  ts.  viVrrtiic,  will  not  cause  failures  or  cxcestlve  redretim 
ia  life* 

3.?.?  KAV-ir:n:xi  TECinC-tS.  ranufactta-lnE  te*niq-jes-and- 
desi-pj  feature.:  ahtil  be  relected  wHldi  elinirate  or  reduce  the  htaasn 
enrers  in  Uie  cor<tr-.xtion  of  the  enuipnent,  and  s.hall  be  coa^tible 
with  the  potential  end  rtte  of  production.  Vac  foUowlnf 

teidmiques  should  he  corsidered  in-ttie  deslena  printed  circuit  boerde  ■ 
to  elirinate  ha.rd  asserblyt  the  repetitive  use  of  standard  MecnanicaX  ' 
brackets,  chassis,  frz-.es,  ete.^  to  reduce  the  variety  of  parts  t4>ich 
nust  bo  fabricated,  and'ihe.use  of  techniques  for  protection  of  parts 
and  wiriiif  £rxi  Csr-ist  causes  bv  hsr/ilinjt.  shippinr.  and  s^torsre* 

3.2.f  C2:'ST^:rriXl  of  ?3JI07i?S  Affl  EVAU'ATION  TEjri:a.  -  Method 
.  of  construction  of  the  rrototype  shall  be  based  on  the  incorpoination  • 
of  infoiT^ation  diswsci  in  tarecedisg  paraerspbs  and  suitable  far* 
inacdlete  use  in  snsduetion.  A  cor.plote  rerios  of  evaluation  tests 
Sitall  bo  conducted  to  assure  that  tne  equip'Sntf  with  any  sodifics- 
tlons  requirec  to  correct  dcfieicncos  found  during  test,  will  weet 
tije  apcMtionol  ard  rerfoi:*nce  requirements  of  the  contract  with  ■ 
tlw  sjecif  Jed  degree  of  reliability  and  naiiital:«bility»  .  'j 

3.2.9  sSl-'^.T,  ir*  Bpoc.  conpletion  of  tnu  detipt..  coitstruc- 

tion  and  svalustlan'of  tJse.prototiT'*  df  ^quiprusnt.  tl*  ©or  trietor 
shall  prepafd  and  suirit  a  report  to  .tee  Gtvernher.fegency  concerned, 
which  contains  the  fsllovinea  ■ 

<t  , 

(ly  R*.  e-iilanation  of  tuc  proeedure.'s  used  to  deter- 
nir*  teat  parts  haw  b'cn  suitably  seiecteH  ard 
applied.  -;:5s  .teoa’d  -e  illustroted  hy  dr 
te.we  critical  eMia{li.3  sltowinf!  parts  ratintto 
wlte  fcircait  wqvirenents  f&.‘  each  particular 

CC)  A  iescriplion  of'  circuit  technique’s  «’.ll»jrd  to. 
eit*irate  or  nini''.ltc  deleterious  effects  on 
equiP'^.'.t  pcrforr-orce  due  to  parts  ari/v.'  Oive 
tuo  or  tiirce  sj^cific  cri*-icai  6Xanr.le.% 

{;'  l.v  calculation  of  the  predicted  reliability 
iaj.'d.uron  t;ie  desjpn  and  data  on  the  typo  of 
parts  used  in  the  corstruetion  of  tne  prototjq:*. 

(h)  CsnsideraUon  river,  to  redun-dency  techniques,  if 
req.ired. 

(5'  A  i;ercr'Z  .Jcscrijilos  of  asserjLiy  desip.n  tecimi- 
ques  i--lec‘.cd, 

(6)  .-r.-eral  de.scriptior)  of  rrecha.nical  structui'es 
seiertei. 

Ii)  A  rai  description -of  nar.ufacturiiiq  teciiniques. 


2?? 


(C)  An  aialyi!*  of  ovalaatisn  t«sts  itiat'  havt 
bsra  mde  to  fnm  the  eQui;tH.it  will  ?ute  th* 

.  reTizrci  legrse  of  reli&bUlt;  and  nair.tainafcility 
under  the  eanditions  af  operation  aiM  imsHinf  os 
opeelf  ied  in  the  cootraet*  .  ' 


(9)  Xnfomation  ^  ihe  features  of  the  eqfuipnent  tbst 
the  eontraetor  considers  weaSc  froa  relisbllltgr 
standpoint  and  the  contractor's  rAconcwitdatjotM 
for  ittroviwient* 

(19)  Infometion  on  conditions  that  will  iie^ovs 
■  cr  iisreaoe  too  reljfciiity  of  the  equt{ziatt 
in  operation^  with  special  consideration  of 
storace,  -handliim  and  naintenanee  ie^!x«« 
nents. 

(U)*  itivr  oU^  eon«nts  or  recon^tations  the 
noMifactarer  deaires  to  nake  on  slapUflea* 
tim  of  desiist,' nd  lability  of  operation  and 
nair.ta inability  of  the  oe;dtn«nt»  or  on  ^  ‘ . 

orerational  te^miaues  and  naintctmneey  «dii^ 
my  inflsenee  reliability.  ' 
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Dlls  T*jk  Pored  found  it  aoeossdry  to  (o  far  ‘biiy<*%l  tha  da 
valopnant  of  aathaiBatlcal  erltarla  a»d  txprasslons  for  eoaifoiisnt 
raliabilitjr  to  accoaplish  tha  tru#-  iatant  of  ita  aissioo* 

Major  cnaocas  in  military  eoapooant  spaeifiertlooat  sathoda 
of  taatlnK.  approval  and  inapaetion  praeticas,  and  in  proeuraaMUit 
and  apacification  daValopnant  pollelaa  ara  found  naeaaaary* 

Substantial  chanxas  in  oaspowar  and  budfatary  alloaueaa  ara 
found  tBandatory» 

A  aathaeutical  and  atatlatipally  valid  baaia  for  davaloi 
and  stating  In  arlthaatie  tarns  tha  criteria  for,  and  nathoda 
expression  of,  Acceptable  Failure  Bate  for  electronic  eonponesta 
is  prasanted, 
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This  Task  Fore#  Is  d««ply  Indebted  to  aan/  IridlvldYials  for 
consultation  and  {[uidanca  In  the  coaplstlon  of  Its  task.  Va  wish 
particularly  to  acknovladia  vith  thanks  tha  spaelal  asslstaaea  of 
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Mr.  Richard  DaWitt,  OASD(AE) 
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Spragua  Electric  Conpary  for  thr  typing  of  this  report  isA  tha 
docusents  associated  with  this  task. 


V.l  The  assigned  aisslon  of  this  Task  force  as  •odlfled  was 
"Establish  criteria  and  aatheds  for  specifying  that  a  eoo> 
ponent  has  a  predetermined  level  of  probability  of  delivering  a 
specified  performance  under  designated  environmental  condition's 
for  a  specified  period  of  tloe.” 

‘.r.2  The  Task  force  found  It  •necessary' to  arrive  at  a  daflnltitn 
of  a  rallabla  coaponent  for  tlta.  purposes  of  its  work,  as  fol>. 
lows?  "A  component  Is  reliable  If  It  has  a  pre-detarnlned  laval 
01  probability  of  delivering  a  specified  perforaanca  under  daslg-' 
r,at}d  environmental  conditions  for  a  specified  period  of  time." 

Thera  are  many  kinds  and  levels  of  reliability,  both" of  cc«> 
ponents  and  equipment,  dependent  upon  the  end  use  and  appll-. 
cation.  It  is  considered  that  the  definition  of  a  rallabla  com¬ 
ponent  stated  above  Is  the  best  that  can  be  developed  for  tha 
generalized  fields  of  application  intended  in  tha  spopa  of  this 
activity. 

The  connlttee  also  found  It  nacess&ry  to  datarmlna  tha  basia 
for  a  statement  of  failure  rate  and  agreed  that  failure  rates 
of  electron  tubes  and  components  should  be  based  upon  thalr  speci¬ 
fication  ratings  and  expressed  in  terms  of  percent  failure  par  . 
unit  of  time  for  each  critical  mode  of  failure,  Including  suffi¬ 
cient  information  as  to  failure  rate  variation  with  environment 
to  permit  an  equipment  design  engineer  to  properly  use  tha  tuM 
or  component. 

‘*•3  IXMITATIOITS  OH  Tir  AXCMrLlsKHgyi  Oy  t  a:  TiSK  By  THI.^  CROP? 

4.3.1  It  was  clearly  rec:>gnlzed  from  the  outset  that  the  findings 
and  rocoBB;enia lions  of  tills  group  would  have  to  be  bessd 
upon  UiH  direct  experience,  'mrvle-ig'e  and  I;'-.,.- -.iKt t*  fact  finding 
of  its  menbers.  No  extensive  test  programs,  as  have  been  found 
noc^sscry  and  to  be  dlscus'.ol  herein,  vara  possible  within  the 
limits  of  this  ttssigrstent. 


1^*1# -Ta  t-Ti  -krtgcjWTJ* 


W.3.2  Th«  T«ak  Oroup  cl««rly  r«eogolMd.UMt  ljt«  rteoaMadatiaQs 
Bust  tM  or  sudi  Dst*ir«  as  to  i^rasarva  tha  contiaalty 
tha  presantly  existing  spaclfleatlons  and  systous  cf  lospaotloa 
op«rated  by  tha  allltary  dapartBants^  avan  though  tha  flMiagg  of 
tha  Task  Korea  indlcata  radical  daparturas  .fro*  thasa  praotieaa. 
if  Uttar  chaos  Is  to  ba  avoidad.  *  Tha  prasMt  systess  aaolaad  oo 
'  tha  basis  of  tha  bast  infonsatioR.  aaapowar  and  financial  allot- 
•ants  aada.  Tha  reeceasencations  to  ba  aada  harais  vlil  ba  faead' 
with  tha  saaa  factors  for  implcBentation. 

4.3.3  ^a  flndlncs  and  reecimondationa  to  ba  oade  by  this  Task 
Korea  wara  eonsldorad  froa  tha  outsat  to  ba  cireuiseribad' 
by  factors  of  aconeni^  and  lo(l«tie  faasibllity  uithin  a  practical 
military  system  and  luive  been  weighted  with  thasa  factors  in  aind* 

4.4  In  order  to  properly  accoaplieh  its  task,  our  croup  found  it  - 
noeassary  to  go  far  beyond  tha  aathflEiatical  or  statistical 
approach  and  to  examina  basic  anvironaental  roqulremants,’  prasaat 
military  practicas,  and  aany  other  factors.  In  this,  its  final 
report,  the  Task  Group  faals  it  necessary  to  report  the  rasvlts 
of  these  subsidiary  invastlcatlons  in  a  brief  manner  to  prasmt 
tha  background  for  its  conclusions  and  recocmendationa. 


Exanlnatlon  of  tha  broad  spectrum  of  military  coapone»^t. 
specifications  reveals  that  there  is  a  complete  lack  of  spsclflca- 
tions  covering  a  subg.tantl4l  percentage*  of  eaaponents  used  in 
military  electronic  equipment  programs.  It  appears  that  the 
specification  development  activity  ar.  now  staffed  and  budgeted  Is 
not  capable  of  keeping  pace  with  t3»e  cquifsent  development  pregraa 
needs. 

5.2  RELATIONSHIP  OF  PEjaiROtENTS  VITIIIH  VARIOUS  SPSCIKICATICXS 

5.2.1  Examination  of  the  exlsvlng  military-. specifications  for 

varloiis  classes  of  electronic  ebapoaents  shows  that  thera 
is  no  consistency  of  the  performance  test  or  quality  assurance 
requirements  of  the  specificattor,-  with  regard  to  one  encthjr. 

This  results  in  the  chaotic  situation  that  a  picca  of  electMnle 
equipment  required  to  be  produced  under  a  contract  for  a  certain 
performance  or  reliability  level,  which  contract  mandatorlly 
referenced  existing  military  component  specifications  and  used 
the  components  procured  under  tlieo,  -would  contain  C(«poflents  with 
a  wide  divergence  of  performance  capability  and  quality  level. 

The  development  of  KTI,-STO-?OP  was  a- recognition  of  this 
lack  of  c.-jr.slstency  ond  an  attempt  to  overcsoc  it.  Insofar  as 
HII.-5?Tn-?02  teste  would  be  valid  for  the  testing  of  component's  in 
relation  to  end  use,  seme  consistency  would  be  provided. 


*  Various  percentages  have  been  stated.  Factual  studies  of  eleven 
particular  equlpnents  .made  by  the  Dureau  of  .Ihlps  show  JAX  and 
MIL  specification  usage  between  5l'-i3=  a.*«d  fi6,4jS,  with  substan-. 
tlsl  pTtloi.s  r.f  the  balance  wt-.ich  could  have  been  coi-ered  by 
existing  specifics tl-ons. 


Th«  Alp  r.esearch  and  Developoent  Cocnard  prapented  to  the 
coBClttea  t  study  of  specification  cotspatlbi;  tty  covering  152 
•Ingle  Service  and  Joint  Service  »peclftcatlc>ns  on  cotnponente 
vhlch  troke  dovn  the  requirements  for  major  envtrormsntel  perform¬ 
ance  for  ready  cemparison.  This  study  shows  very  wide  divergence 
in  the  performance  requirements  and  a  gene re!  lack  of  consistency, 
which  Ir.  part  reflects  the  various  levels  of  available  component 

capatlllty. 

there  are  wide  differences  In  the  progress  of  quality  and 
reliability  levels  In  various  component  specifications.  Somewhat  - 
acre  vork  seems  to  heve  been  done  in  the  electron  tube  field,  and 
mer<  direct  Implementation  of  requlremettts  for  quality  control  and 
lell'ahlllty  are  fqntalnei  in  the  more  aedern  tube  specifications. 

5.2.2  hraalnatlon  of  '.he  sampling  table,  number  of  samples  tested 
per  requirement,  number  of  failures  permitted,  etc,  l.n  the  . 

various  military  specifications  Indicates  that' they  do  not  contain 
a  statistically  valid  procedure  for  any  statement  of  reliability 
In  us  .  The  numbers  of  samples  chosen,  the  numbers  of  failures 
peraltcei,  tho  sampling  schemes  used  In.  many  cases,  are  purely 
arbitrary,  and  It  la  not  possible  from  the  results  obtained  to 
give  any  assurance  of  any  level  of  r-l.l-.blllly.  ’  The  sampling 
scht'Ucs  used  iti  general  are  based  on  the  A^  concept,  vhlch  Is 
shewn  In  the  mathematical  section  of  this  report  to  require  fur¬ 
ther  augmentation  If  the  true  requirements  for  reliability  are  to 
be  act. 

5.2.3  The  test  eon.Htlohs  called  for  In  the  various  military  com¬ 
ponent  specifications  were  examined  with  regard  to  the  con¬ 
ditions  of  known  envlronrenta  to  vhlch  military  electronic  apparatus 
Is  subjected.  There  Is  a  general  lack  of  known  relationships  be¬ 
tween  the  presently  used  test  conditions  and  the  absolutely  known 
environments  fur  the  equipment.  There  is  much  less  correlation 
betve'»r.  the  test  conditions  and  the  actual  environments  for  tha  ' 
components  since  the  cdspo.nents  tsay  operate  In  substantially  dif¬ 
ferent  environment  within  the  equipment  from  tJiat  to  Vhlch  the 
eculpmert  is  subjected.  The  test  conditions  called  for  In'present 
military  specifications  were  the  outgrowth  of  available  test 
apparatus  and  test  methods  and  have  not  be-r.  determined  In  rela¬ 
tion  to  the  actual  environmental  condltlcn.'  to.ovn.  T.xhlblt  1 
certain.*  the  operational  environments  for  military  electj’onie 
equipment  obtained  from  the  three  Arr.ed  Services,  The  ccmparlson 
of  this  ts.ta  with  component  specifications  quickly  reveals  the 
ccn.iltlcns  stated  herein. 

5»2.«  Accelerated  tests  are  used  In  numerous  military  component 
sricif Icntlons,  To  be  of  value  In  the  ejtabllshBier.t  of 
reliabiilty  criteria,  the  acceleration  factors  cf  th-  test  with 
respect  to  use  ccndltlcns  must  be  known,  Ir.  cr.ly  a  very  few 
Instances  is  there  any  such  known- relationship  to  Justify  the 
“cce. oration  factors  used. 


5.2.5  Th-u  te.sllt'g  perfornsi  under  present  iillltary  component 

srrclfic.ationa  determines  *he  efft  s  on.  In-.lvidi'.al  param¬ 
eters  cl'  *hv  cem-ponertf  by  exposure  sv.r  Ively  to  single  cr.vlron- 

ct-ts.  This  practice  Ice?  no*  represert  rvlce  conditions  since 

ftlr:;*  j-.rcly  the  ccgrcca*- Ion  and  fat’-ure  of  components  is  the 
r-jsult  ;f  Ih.c  action  cf  ccntlr.atlon  art  multiple  envlrcr.'.-.ents 
op-ratl  r  slmulteneoufly,  Ihe  legra  Ir.tlcn  rats^  cf  v.«rlcus  matei 
r'.alr-  a;,  .-cmpon'jr.ts  ns  the  rtsuit  of  ccnblratlc-  environments  are 
d-.-p:  -t  upon  ihe  nccc-lcratlng  effect?  of  rne  e-vlronment  upon 

6r.ct..cr,  a:.;  ar«  largely  unknowr  , 


Th^  inJlvlduai  conponent  dlvlr.lons  of  the  verlpu*?  mli.lterf  I 
services  contain  aany  highly  skilled  and  technically  ccmpetent  b 
Individuals.  l>wever,  there  Is  serloMs  >jucs*ljr.  regarding  pe  | 
technical  vail  11 ty  of  the  specifications  which  are  developed  be..  | 
cause  of  the  r:annc-r  In  wl.lch  these  Indlvldiis  •  nust  work.  The  •  I 
necessity  fs-  ratl.nalislng  "ir.ny  divergent  viewpoint,  for  reaching! 
agreenent  between  *hrfce  Servlce.s  wlti:  different  needSt  and  the  '^•“1 
qulrenent  fir  broad  Industry  agreeisent,  resul*  In  svine  cases  In  a  | 
Sj.eciricatlon  which  Is  a  cenpromise  of  corpror-lses,  and  which  aay  I 
not  have-absolute  technical  validity  in  relation  to  the  purpose 
and  intent  of  the  specification. 

5.3.1  the  speed  of  dcveicpcent  it  military  component  .epecifice- 
tions  is  entirely  inadequate  for  the  pace  at  wt’.Ich  new  • 

apparatus  is  oelng  developed  to  meet  prese.nt  and  foreseeable  alii.*' 
tary  needs.  It  is  estimated  that  only  fifty  percent  of  present  . 
conp-jnens  needs  are  presently  covered  by  caoponent  specifications.* 
It  Js  obvious  that  the  manpower  a.nd  dlrectlve.s  of  this  activity 
ne  d  expansion  and  tnat  the- system  of  developing  specifications  , 
must  ho  Lmpro-ved,  '  - 

5.3.2  T!;e  system  -of  cdmlnlstratlon  of  both  tha  development  and 
application  of  military,  c.-omponent  specifications,  although 

competent,  is  inadequate  In  that  personnel  rest.'d'’ti.ons  and  basic- 
di»*e.otlves  limit  the  effectiveness  of  tha  Job  whl-sh  can  be  done*  . 

5.3.3  application  of  the  present  military  .component  specifi¬ 
cations  by  the  nllitcry  inspectors  in  component  manufacture! 

plan's  In  most  cases  does  not  insure  any  consistent  level  of  prod¬ 
uct  quality,  and.lt  cannot  do  so  because  the  specifications  them¬ 
selves  and  the  particular  sampling  schemes  applied  to  Itea.q'  product 
on  a  lot  by  1-at  basin,  and  variable  lot  quantities,  carjnot  insure  . 
with  any  degree  of  confidence  any  particular  level  of  quality  in 
the  product.  Qualification  approval,  which  Is  extended  to  a  par¬ 
ticular  components  manufact-arer  on  the  basis  of  a  single  sample 
submission,  slsply  indicates  that  at  one  thme,  with  one  particular 
group  of  materials,  one  small  lot' of  units  was  produced  which  was 
capable  of  demonstrating  conformance  to  an  arbitrarily  established 
•Sot  of  test  requirements.  The  qualification  approval  itself, 
therefore,  gives  no  assurance  of  any  continued  or  sustained  quallt 
level  In  .'■he  future,  except  Insofar  as  the  Inherent  good  faith  and 
quality  control  of  the  rcenufacturer  provides  it.  The  subsequent 
ifilUtary  Insj'ectlon  of  random  lots  cannot  even  with  the  most  rigid 
adherence  t*  t.hc  requirements  of  the  specification,  which  seldom  . 
takes  place,  insure  any  definite  known  or  expressible  quality  lev*] 


pi 


REf.IAELE  C 


6.1  Voluminous  data  has  been  produced  to  show  tha  relationship 
to  system  reliability  of  tie  ninaoers  of  components  contained 

in  a  system  end  the  individual  failure  rates  of  the  c-oopohents. 
Figure  1  snd  Klgura  2  show  such  relationships. 

6.1.1  W-Jt  Is  Incoaplelely  understood  in  a  dute-ralnstlon  of  com- 
p.ment  failure  rate  Is  tfie  degree  t.o  which  the  parameters 

of  a  coffl?''r!ent  nay  shift  from  BCdlan  or  ra-ted  values  ajvl  still  be 
toieraoie.  *-bvlcu.sly  U-.o  ioi.>rftble  clia.Ui'es  in  r--fa®eters  from 
application  to  sppllcstlon  for  «  single  component  can  cover  a  very 


broad  rans«  and  still  pamlt  it  to  bo  usoful.  Hov  to  cttacorlM 
ouch  parsnotar  ehandas  Into  raecitnlzabla  and  controllabla  IlJilt 
groups  so  as  to  develop  .usabla  failure  rate  Inforaation  fur  par* 
ticular  classes  of  end  product  use  is  a  aajor  problea. 

6.2  THe  KINDS  OP  COSPOMEWT  RitlABILlTY 

Han)  kinds  of  reliability  say  be  required  of  a  sir4(le  alee* 
tronic  component  dependent  upon  factors  as  follows: 

6.2.1  Reliability  in  operational  use  *  the  definition  of  such 

reliability  is  inssparebly  related  to  the  kind  of  end  equip* 
Bent,  to  the  kind  of  aissicat'of  this  equipment,  *xy  the  duration  of 
this  mission,  ate. 


6.2.2  Whether  or  not  a  cctponant.  which  has  been  stored  In  a  supply 
or  repair  depot,  or  has  been  in  storage  In  a  place  of  com* 
plete  end  equipment,  functions  within  Its  required  -paraseter  tol¬ 
erances  when  culled  upon  to  do  sc  can  also  be  interpreted  as' a 
kind  of  component  reliability.  We^re  fiiced  here  with  variable, 
end  In  many  cases  Indefinite,  perloou  of  storage  under  a  variety 
of  storage  conditions:  To  »d-jt  extent  there  .Is  degradation  of  the 
components  and  a  isathematlcally  assessable  failure  rate  or  contri¬ 
bution  to  failure  rate  for  this  factor  is  unkncwn. 


6,2.3  I^or  a  single  component,  presumably  any  component  produced 
under  present  Bllitary  component  specifications,  a  wide 
range  of  performance  reliability  as  dateralned  by  failure  rata  can. 
ba  experienced  dependent  upc«  the  actual  percentage  of  rated  stress 
applied.  For  example,  a  capacitor  or  a  tuba  may. have  under  exist¬ 
ing  specifications  a  certain  maxlaua  raled  performance  capability  - 
with  which,  by  properly  designed  tests,  wa  can  establish  •  failure 
rate.  What  Is  the  failure  rate  for  conditions  of  operation'  wltt»- 
regard  to  each  important  rating  parameter  if  the  component  is 
operated  at. lesser  levels;  e.^.,  voltage,  current,  temperature, 
etc.?  Simply  stated,  vtist  safety  factor  in  component  reliability 
can  be  purchased  by  more  ccRaer\-*tiv«-use7  This  is  a  highly 
Important  fector  in  rellsblllty  and  the  answers  for  most  componants 
snd  parametars  ara  luikncwn. 


6,2.*t  Oie  of  the  most  seriously  lacking  piacas  of  information 
with  which  to  establish  un  accurate  nuaerical  perfomanea 
rating  for  any  component  is  the  Inter  relationship  of  rating 
severity  and  use  severity,  storage  degradation,  etc.,  and  tl»a  ob¬ 
taining  of  Infornstlon  for  such  inter  relationships- would  seeoltigly 
be  a  gargantuan  task  beyond  ecor.«,_c  practice xity. 


6.3  ng:  E.T/pi'.’.igsTi  ENc.')?Mrr?-^  gr  c-T.rorffiHTs 


6.3.1  .0  f-allure  rotes  or  rellsblllty  ratings  for  components  can 
be  devoiopcfi  outside  of  direct  relationship  to  eperating 
cnvlroncents  and  are  ir.eaningie.>s  vithrut  such  relationship. 


:t  is  Incunbent  an  the  .*qulpcc..;  -dr-slgner  to  Ihs-lt  the 
actual  c  ";  orient  onviruacent  t'  as  lew  an  amplification  as  possible 
over  that  of  the  "black  box"  e-vi^-rr-rent. 


vlr.'>n.7.6:j* 
tlie  Ar'ed 


■how  lr-S5rhlllt  i  t.he 
f'.-r  the  operation  of 
Tervlees,  The  actual 


stated  pi’esenr  and  foreseeable  en- 
r'.etT'r.ic  equipment  by  each  of 
cnvtrr.nnent  in  wlilch  a  component 
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operates  nay  be  aore  or  less  severe  than  this  equlpeent  environ¬ 
ment,  dependlnr;^  upon  such  factors  as  euollne,  shock  nountlnf,  pro-' 
tection,  etc.  7}ie  liaittn^  environments  which  will 'give  acceptable 
failure  rates  for  the  components  must  be-  tlie  basic  guide  to  equip¬ 
ment  design. 

6.4  •  THE  EFTCT  or  MISSION  LEKC-y  QW  ACCEmiLE  FAILtlHE  RAIE  .  * 

6.4.A  As  stated  under  6.2  above,  many  levels  of  aeceptible  failure 
rate  are  possible.  A  cooponent  aay  have  one  acceptable 
failure  rate  for  short  time,  hlgn  intensity  enviroment  and  a  very 
different  tolerable  failure  rcte  for  lo-g  reduced  severity 

environment.  The  f&llure  rate  which  is  put  on  the  component  must 
therefore  be  directly  related  to  the  mission  length  of  the  e^ 
equipment  in  which  it  will  be  used.  Task  Croup  No.  1  will  provide 
us  with  the  minimum  mission  time  for  each  class  of  alectronlc 
equipment.  Peworklng  of  military  component  specifications  must 
then  change  the  test  time  to  give  proper  informatl^  for  a  fellurt 
rate  or  reliability  rating  consistent  with  these  mission  lengths. 
The  mathematical  section  of  this  report  daeonstrates  how  this  can 
be  done. 


'7.0  coiJCLpsicus 

As  stated  in  tbs  introduction  to  this  report,  no  attempt  ie.  * 
to  be  made  here  to  doement  in  datall  the  findings  or  conclusions 
here  to  be  presented.  They  ere  besed  upon  thorough  discussion  and 
the  direct  experience  of  the  Task  Force- members,  togethvr  with  tht- 
■flndlngs  of  the  several  invastlgations  conducted  as  part  Of  this 
task.  Our  coaclusioos  aret  ,  ■  ’ 

7.1  Our  present  military  coopooent  specifications  do  not  describe 
or  give  essuranee  with  regard  to  the  cooponent  relieblllty 

levels  now  known  to  be  necessary. 

7.2  -  The  present-  systen  of  qualification  approval  of  components 

can  be  considered  only  as  s  Halted  proof  of  deslgu  capa¬ 
bility.  It  is  impossible  to  apply  first  area  statistical  proce¬ 
dures,  such  as  the  concept  of  AQL.  to  the  manufacture  of  compcsieDte 
using  the  requirements  for  quallficatlor.  approval  as  .the  basis  for 
Insuring  or  establishing  reliability  at  predetermined  -  levels  of 
bmt.Isus  fail'ure  rate.  We  cannot  use  the  present  concept  of  q'leli- 
flcatlon  approval,  with  the  existing  military  inspection  system, 
es  a  basis  for  insuring  component  reliability  at  any  level. 

7.3  The  present  military  inspection  practices  as  applied  to  com¬ 
ponent  parts  suinufacture  do  not  and  cannot  police  reliability. 

levels  or  provide  the  information  necessary  to  insure  the  end 
equipment  user  any  stated  level  of  reliability. 

7.4  Present  anvironcental  test  methods,  as  contained  in  KIL*STD-2C2 
•cr  MIL-E-1,  were  net  designed  s.i  tiie  netiiwls  for  obtaining 

the  infcrmatlon  with  which  to  establish  failure  rate  lnfonutior» 
Tliese  iretnorts  are  l-irgely  the  outgrowth  of  existing  oqulpoants  and 
t-^t,  laboratories  ar.d  require  modification  and  mcxlernizatioa, 

Thoy  do  not  correspond  to  anticipated  eivlroi^ental  conditions. 

7*5  Ferforsance  requirements  of  componimts  In  prasent  military 
spaciflcatlons  do  not  fully  reflect,  currently  needed  actual 
relatJonsIips  to  ti»e  c-japonent  end  use,  and  it  impossible  to 
relate  tliem  to  such  end  use,  with  present  inforw.-tlcn,  in  a  known 
and  sUtlsclcally  valid  manner. 

r-fj 


7«6  Dm  .l*,rr*d«tion  or  fallttr*  ntos  of  sost  prasaat  ailltar/ 

cospononts  and  tha  aatariala  of  tbair  coapositloa  ara  larftlf 
uakncm^  even  for  sine  la  anviromantal  eondltioaaf  aad  ara  eoai- 
plataly  unknown  for  tha  affacta  of  coablnatloD  anriroipMOta* 

7  >7  Tha  prasent  fovamaant  ragulatloaa  for  drafting  allltary  eaa» 
penant  apeciflcatlona  auat  he  amended  if  thaaa  apaeificationa 
ara  to  aatablish  tha  raqulrecenta  fer  rallablUty  baaad  on  faiXura 
rata  infonutlon. 

7.6  Tha  lapleaaiitlng  of  any  eoiulstant  prograa  for  tlia  development 
of  raliabla  apaelficatloaa*  tha  carrying  en  ,<;>f  tvvt  profraaa 
to  obtain  lha  basic  InfcnMtioo  nacanaary*  tha  ci-eeeal-af.-lon  ©r 
this  Infomationt  tha  control  of  aanufaetura  of  cjapcnaata  aaatlag 
the  requirmanta.  must  in  soaa  way  ba  cantrslizad  aad  coordinated. 

It  cannot  expected  that  reliability  will  result  if  yarioua 
Krtlona  of  tha  coaponant  prograa  ara  aaparataly  and  Indapandantl/' 
controlled.  ■ 

fantastic  aaounts  of  anginearing  aanpover  and  teat  facilitiaa 
ara  being  devoted  by  cooponenta  and  aquijnant  predueara  and  agan*  . 
cias  to  Component  rallabllity  studies  In  coaiplata  duplication  of 
Mork  dona  alsawbara.  Ibis  must  atop. 

7.9  In  order  t.'^  provide  the  equipment  designer  vltli  the  necessary 
tools  to  design  reliable  equipment-,  failure  rate  Infonaatlon 
must  be  made  available  in  terms  of  percent  failures  per  unit  ttae 
for' each  critical  mode  of  failure  or  parameter  change,  including 
sufficient  information  as  to  the  variation  of  fallura  rata  with  ■ 
envlronmant  to  permit  the  proper  use  of  the  tube  or  conponent.  ’ 

?.10  '  Tne  preetlcal  eccotplishnent  of  the  true  overall  task  of  this 
group  will  be  a  long,  difficult,  and  tortuous  Job -which  aust 
be  carried  out  on  a  continuous,  full  ilaa  basts  by  a  peraanant  group 


e.O  P.ECOHt<E?bATIOS«; 


It  would  be  dengerous  and  destructive  lo  wipe  cut  and  supplant 
at  one  stroke  the  present  military  component  specifications  and 
Inspections  systems,  however  Inadenuete  they  have  been  found  to  be. 
Whatever  system  Is  aeveloped,  based  upon  the  racoomendatlons  here¬ 
in.  must  be  gradually*  introduced  with  the  bcxIcuc;  practical  speed 
wlth-jut  disrupting  the  military  procureoent  program*. 


6.1  Tl-.e  present  practices  of  most  military  component  'ispeetlon 
have  been  found  herein  to  be  Ineffective  and  incapable  of 
Insurlixg  any  stated  level  of  reliability.  It  is  rec-jumended  that 
ths  present  specifications.  Inspectlrn  practices,  en-1  quality 
acceptance  prece.-luro*  be  codifle-t  lEsedlately  to  esture  that  the 
r-.-ll'ibll.lty  inherent  in  the  quallfic.-!  product  Is  nalr.talned. 
Lasediate  consideration  should  te  given -to  more  critical  Inspec¬ 
tion,  and  to  a  beds  for  at  least  scsl-annuaX  rcquallficatlon  or 


."3  - 
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$.2  )l«w  sp«el/leatlons  aust  b*  dev*lop«4  for  t  true  rollabillty 
prosraa  Which  contain  statistically  dasiKned  experiaents  to 
product  the  aaxiaui  of  inforaatlcn  fro*  the  miniAua.  msiber  of  tost 
saoplasi  and  aust  contain  tha  proper  tests  in  sinsla  and  aultipla 
anvirennents  related. to  tha  end  use  of  the  components  to  specify 
the  fall’ire  rate  yith  relatlo»i  to„varto«s_  aey^rltiee,ojr  test, 
ls»  levels  of  reliability  dependent  upon  severity  of  use  factor 
must  tw  ostabllshad  in  a  <*Iear  and  statistically  valid  manner. 
Appendix  I  of  this  report  prftY^daa.,snf  .apprgpch.t:*!:,, jpgigging  tta 

fgg<;rlsgr.ta  adA  o.b,td^nji4«L^hg.xp4rab,i^,y.  - 

actors  in  a  lUitedTbut  gstful  f:/rs.  *o  implement  such  a  program 
may  require  modification  of  exlstin;  regulations  and  directives  by- 
Whleh  military  component  speclfieetKn'-s  are  developed. 


8.3 


the  Armed  Services  should  be  asked  to  reconcile  the .divergent 
environmental  requireoents  ^.tch  they  have  expressedi  and  to 
a  s^niile  set  of  coordinated  environae^tal  conditions  tdtlch 


cAiiatea. 

Tor  the 


V.I  w^e  tertljix  o?^o"ar<onento  to'es^b* 

e^nyircrc'^.t£.-e  and 

when  the  ecovc  snvirunmental  coort 


—  _ _  -  _  _  _ jnvlronoental  coordination 

has  bean  established,  to  provide  tests  and  severities:  v!iich  truly 
moasura  the  performance  of  coin;>onents  for  these  environments,  lha 
severities  of  test  to  be  established  must  be  based  on  the  factors 
developed  by  ACRE!?  Task  Force  Mo.  1  for  the  reliability  levels  of 
'equlpcent  necessary  in  the  light  of.  such  parameters  as  mission 
length,  type  of  equi^ent,  and  end  use.  Several  severity  levels 
Will  be  mandatory,  the  subsequent  design  of  equipment  mUst  then 
mandatorily  be  such  that  the  end  use  of  the  e-omponents  is  than 
limited  to  these  environments  if  reliability  is  to  be  achlavsd.  - 


d.b  It  is  recoomended  that  as  part  of  tha  qualification  approval 
or  other  govarnaent  procurasant  proeadura  of  a  eomponeat  that 
a  sufficiently  large  number  of  samples  be  tested  to  establish  - 
primary  failure  rates  for  the  important  parameters,  ps  required 
by  the  specification  and  developed  in  accordance  with  tha  methods  . 
of  Appendix  I.  If  the  results  cf  these  tests  justify,  the  supplier 
ohould  then  be  investigated  further  to  hie  "in  plant'  quality 
control,  operating  \mder  a  new  xrocedure  given  in  the  r.art 
rccoatT^rdat  Ion. 


8.5  Ttie  system  of  military  inspection  and  approval  of  supplier 
techniques  should  be  revised,  the  supplier  of  military  eoa* 
ponentn  should  be  rated  as  an  "approved  supplier"  or  "supplier  of 
reliable  components"  based  upon  e  new  system.  This  system  would- 
establish  an  organization  which  would  examine  and  approve  the  "la 
plant"  inspection  and  quality  control  proceluxos  of  the  s.upplier  ' 
.Initially,  and  would  make  periodic  re-examinations  of  the  record, 
keeping  and  results  of  th»so  procedures,  the  supplier  to  remain 
approved  only  for  the  time  duration  between  Inspection  periods  and 
only  if  the  record  keeping  and  process  control  systems  are  main* . 
tained  adequately. 


Shipments  of  components  from  such  in  approved  plant  would 
than  not  te  based  on  an  unlimited  "..uallfleation  approval"  as  now 
grautoJ,  but  would  be  based  on  ttie  cor.t :jiuOU .  flow  >f  quality 
control  data  indicating  product  and  process  in  control  with  ade¬ 
quate  inspection  and  record  keeping  to  insure  this  result. 


The  coarslttee  has  been  advicei  rhat  this 
hy  an  Ad  {!cc  Group  .,per.atlnr  ur.ier  ACr.?. 
full  time  task. 


work  has  b^-en  started 
It  should  be  a  prime 


8.6  It  is  rseoMendcd  thst  ths  dsvslopMnt  of  Qilltarjr  caspmsnt 
specifics tions^  the  testln,*;  of  exponents  for  Oesifn  espshiUtr, 

and  the  i^evelopnent  of  Inspection  aethods»  be  Integrsted  and  co¬ 
ordinated  by  one  eontrolllnc  (roup  at  D.0.0.  level*  The  (roup 
should  be  conprlsad  of  representatives  froa  Industry  and  fro*  the 
three  Services,  lncludln(  personnel  froa  Research  and  Developaent, 
Standardize ticn,  Procuressnt,  and  Quality  Assuranca  functions. 

Adequate  supply  of  unpover  and  budget  to  establish  and  operate  a 
proper  and  coordinated  systeo  Bust  be  provided. 

6.7  Tm  accuaulallon  and  feedback  of  infomatioti  froa  usage, 
failure  repot-ts.  or  controlled  experlaents  on  coaponehts  aust 

be  obtained  by  and  directed  to  e  centralized  organization  estab¬ 
lished  as  in  8.6  above. 

Tnis  inforaatlon  should,  then  oe  used  to  daternlne  whethar- the 
specification  in  existence  coveriR(  tlit  coaponent  in  question  la 
adequate  for  the  end  use,  and  where  excessive  failures  appear, 
whether  ths  quality  control  inforsatioo  rf  the  coaponants  suppllar 
eorralatas  with  the  infcrsat'-cn  fradback.  In  tha  ease  of  continued 
or  flagrant  failure  of  coeponents  to  perfora  in  the  field,  assueiag 
proper  specification  and  ei:d  use,  a  decision  aust  be. made  as  to 
whether  the  supplier  should  be  continued  on  the  approved  Ilet. 

8.8.  The  further  wrk  to  be  dose  to  iaplment  the  task  assignad  to 
this  group,  as  herein  recoemended.  should  be  sade  tha  respon¬ 
sibility  of  a  peneanent  cc«aelt*at.  consisting  of  proper  rapresentatlon 
of  military  and  industry  personnel.  This  coaealttee  should  have 
policy  making  power.  Some  areas  of  continuing  activity  for  this 
group.  shouW  bet 

.  8.8.1  Review  all  existing  reliability  prograas  and  projaet'  nov 
being  perforaed  by  the 'Services  and  establish  coordination 
and  eliminate  duplication. 

8.8.2  Deteralne  what  farther  work  needs  to  be  performed. 

8.8.3  Indicate  what  contracts  should  be  established  for  perfos«- 
ing  work  in  the  needed  areas. 

8.8.4  Sstablish  procedures  and- methods  for  disseainating  the  in-, 
forma  lion  gained  from  this  activity. 

8.8.5  Kstablish  a  basis  for  providing  documents  which' are  coa- 

.  penion  to.  but  separate  from,  specifications,  which  con-  .  . 
tain  ;j3o  an.'’  .application  notes  for  components  to  insure  rellablilty 
In  use,  including  common  environments  and  conditions  other  than 
those  contained  in  the  specifications. 


PREFACE  TO  APPENDIX 


Th«  aatlwMtical  <Jl9eus»ior.  presented  in  Appendix  I  it  not  ■ 
Intended  as  an  absolute  oevelopaent  of  the  ot^  beat  wthod  of 
failure  rate  expression.  Hj  eothod  can  be  absulute.'  Cej>tain 
assumptions  anist  be  made  to'errlve  at  arltbaetie  expieaaton^  .  ^ 
which  limit. the  range  and  Integrity  of  any  practical. method  of 
expression. 

This  Appendix  la  Intended  to  illustrate  the  complex  f  Actors 
which. must  be  considered,  and  to  Ahox  how  a- useful  arithmetic 
sclution  may' be  derived  within  the  limitations  of  tha  practical- 
aaaumptlons  made. 


APPEHOIX  X 


M«Lati-X9r.P.<a>89BiyaX..g,cILiiLrll>ty  i<i4.M«8la>aM 

Evon  tJi*  Bost  cursory  eonslderstlon  of  tbs  problwt  of  ea«- 
ponent  reliability  lead  Isssespably  to  the  sutthsMtlcs  ana  •sebaaies 
of  statistic*  for  expression.  Much  vcrSc  has  alraaf/  fceaa  not 
only  on  the  foi-mal  develo^aent  of  statistical  sethodsy  but  ca  the 
application  of  such  aathoda  tu  Uw  probleas  of  both  eoaiponent. and 
equipcent  relit bility.  Mo  atteapt  vlll  be  aade  here  to  develop  or 
expound  either  particular  theories’  of  statistics  or  their  applies* 
tlOB  in  detail. 

A  short  bibllocraphy  of  highly  inpoitaat  and  applleabXa  ref*'- 
erences  is  mcVjdad  at  the  end  of  this  section.  Sosa  of  the  asst 
straight  forward  exposition  of  statistical  aathod  end  its  appllca* 
tlon  1$  (Ivon  in  a  series  of  five  acnegrapht  by  Mereut  A.  Aehesca« 
a  aeffib,r  of  this  Task  Fcrea.  which  are  insloded  in  the  bibliography.. 
Although  presented  In  relation  to  electron  tubes,  the  statistics 
end  methods  of  these  aonographs  are  readily  geoerallsed  for  use 
with  any  type  of  coaponent. 

We  will  stteapt  here  to  show,  in  soaewhet  concentrated  fora., 
some  nf  the  aatheaatical  probleas  end  epproaehet  l“?olv*d  la  the 
developaisnt  of  axoresslons  for  ccapuneot  reliability  lA  tarms  of 
failure  rata  as  umbers  laving  both  usefulness  sad  validity* 

the  expressi**;  .st  failure  rate  for  a  single  •eoaponeat  ia  a 
single  test  enviroment,  is  relatively  wtraight  forward  whan  va 
have  previously  defined  the  word  "felli’re'*  explicitly  to  aaan  opea 
or  short  circuit,  failiure  to  functlcr,  excessive  change  of  eertaia 
lepurtaht  peroaaters  of  the  coaponent,  or  any  presetted  set  of 
iiaits  of  degradation.  Obviously,  if  we  test  "M"  coapocents  in  • 
given  test  envlronoent  or  set  of  conditions  for  e  tine  ”7*,  and  we 
f.lnd  that  **n''  units  fall  to  function. cr  *xcaed  tha  prestated  liaits 
of  parameter  change  in  this  tins,  we  have  established  a  failure 
rate  of  s  •  n/T  per  hour. 

If  we  neglect  or  weed  out  the  very  early  faliures,  and  le- 
strict  the  time  of  test  to  a  period  shorter  than  the  oneet  of  losowa  ' 
chemical  or  aechaitlcal  degradation  effects;  e.g.,  *vetr  out -fail* 
ure",  w«  can  arrive  at  certain  simple  expressions  cf  reliability* 

"r."  is  the  probable  fraction  of  the  given  coaocnent  falling 
per  hour,  if  "S"  is  the  total  nvwber  of  such  coapenents  tested,  or 
maintained  in  constant  population  in  a  given  eq-uipnsuit,  and  *$"  as 
above,  is  the  number  of  parts  failing  per  hour,  or  r  *  ^  . 

If,  for  the  identical  set  of  test  eevironaents  or  operating 
condltlojis  we  establish  failure  rates  for  vvrlous  coapeoants  as  r,, 

1*2 ,  r*  — rp  and  these  cossponents  ere  applied  ia  varl'^us  qaan- 
tttles  in  an  tquipnent  respectively  n^,  aj,  nv  — —  a^,  the  orerell 
rallure  rata  per  hour  c-an  be  stated  ?f  = 


>S  for  ih«  or  tost  tlas  "t"  hours  th*  totsl  fsiluroi  .  * 
rs  snd  th#  rcllsblllty  of  ths  squlBaont  or  group  Is  »  •  • 
^cnvsrssly  ths  unrsllsblllty  Q  *  1  -  R.)  How  hsppy  ws  eotild  b#"* 


SIM 

SfS  . 

(Ccnvsrss) 

If  ym  could  s  «t«  our  rsllsblllty  problsa  so  slAply  with  say 
assursnrsf  Okifortunstely)  as  ws  shall  ssSf  vt  cancot  do.ao* 


Ritrsoh  (Rsfsrstics  9)  has  shown  w  chart,  Flfora  3»  to  Ultts* 
trats  probability  of  a<}ulpatht  surviving  for  20C  opsrational  hours 
with  various  nuubars  of  cowi^ononts  of  fivs  dlffarsat  failurs  rata 
lavsls. 


m 


Hill,  Vosghtlsn,  and  fuah  (R.farsAce  10)  hava  shewn,  saa 
Flgara  2,  the  aean  life  expectancy  of  systeas  of  various  conponeat 
eocplexlty  when  the  failure  rate  of  the  cespenaats - Is  varied  over 
vlae  limits. 


Uien  wa  are  prbseated  a  certain  ntisber  of  any  alvaa  eoaponaaty 

... 


B- .  ai^  we  have  tested  or  observed  It  as  outlined  above,  and  have 
c.<;erslned  for  this  nuaber  of  \mlts  a  failure  rate  rv,  tdyst  do  ms  ^ 
know?  ^t 'bonfldence”  can  we  have  that  this  rj.  Is  charaeteristlo 
of  this  coaponent?  Does  it  raprssent  all  othsr  eonponenta  of  ths 
same  type,  frea  the  sane  lot{  froa -preceding  end  following  aanil*. 
faetttred  lots?  Using  the  sane  single  test  conditions  and  prs« 
established  failtu'e  criteria,  how  sure  can  tat  be -that  tha  ri  MS 
have  now  obtained  will  bold  for  all  such  units  tastad  and  Is  a 
safa  figura  to-use  In  calculating  adulpaent  raliability?  Supposs 
Boot  of  tha  tested  units  fall? 


Herein  is  the  crux  of  reliability  tha  cotifidenca  whldt  ms 
can  have'  tliat  any  nuaber  of  tastad  units,  under  any  steted  test  or 


parfonuhee  conditions,  will  give  us  an  answer  that  Is  raprssenta- ' 
tlva  of  the  true  performance  of  that  lot,  ooaponent, -or  eatogory.  -* 


If  none  of  the  units  fall  can  we  have  high  "confidence**  that  tbs 
units  arc  rellabla**  Pres  a  statistical  standpoint  it  can  bs  shown 
thst  we  nave  aore  reel  date  and  can  perhaps  establish  a  bottar  ' 
confidence  If  sooe  ordered  number  of  units  do  fell  in  a  raeognlt* 
-abl#  suuuiarl 


The  establishaent  of  this  "confidence"  involves  the  extensive 
application  of  the  satlieoiatlcs  of  orobability  for  reduetloo  to 
reel  nvabers.  The  pro'-lsn  is  coeplicsted  if  we  restrict  the  data 
to  be  obtained  to  a  single  set  of  peraaeters' for  any  coaponant  In 
a  single  test  environment.  It  becomes  aore  coaplex,  but  still 
Mnsgeahle,  if  ve  are  concerned  with  the  effecte  on  the  sane  paraa- 
etars  of  successive  exposures  to  different  tingle  envlrnwents. 

It  is  whan  we  try  to  reduce  to  mathcaatlcal  .terms  the  effects  on 
ths  aultlple  pertneters  of  e  coaponont  of  simultaneous  coeblnatioa 
enrirenseots  -  such  as  are  representative  ^  actual  cervlce  eondl* 
tions  -  that  ve  seemingly  reach  the  limit  »  present  practical  - 
application  of  statistical  theory.  Kev  theories  ere  being  devel- 
cpM,  particularly  the  technique  of  "response  surfaces",  idilch  nay 
be  helofcl  in  the  future. 


Me  shall  quote  liberally  from  icheson's  Monograph  Ho.  5  to 
illustrate  the  basis  for  a  mathemattcai  approach  to  our  problca. 


The  generally  accepted  use  of  statistical  procedures  for  prod* 
vet  arceptar.ee  are  based  largely  on  the  econc&ic  factors  of  sample 
Jet  inspection  versus  IC'OJJ  product  .Inspection  and  are  the  outgrowth 
if  basic  verk  by  D-xlce  and  Romig.  MIL-STi/-lC5  is  based  largely  on 
he^e  procedures,  “its  procedure  evaluates  a  coaponent  In  its 
■rese.'-.t  state  for  the  purpose  r.f  der srslntng  whether  we  can  intro- 
.  uce  that  ccoponent  into  a  system  vtUiout  acre  Uuin  a  permlssibla 


'.L 


Isa 


a  ^viTid  «cuiriiyra^ni.^vJrrf-ftrm. 


iAount  of  iMedlot*  uroubl*  —  for  oxMplOf  vlthout  too  «itv«r<«  oa 
••ffoct  on  tho  nuaber  of  wrkabio  systoas  producod.  or  convorMljr 
on  th«  nuabor  of  sy4Uos  which  will  roqulro  ropolr  or  rwwk  to 
Mko  than  tectptebla.  This  procadgro  will  not  .pr^vlg*  kfil  tofaCTi- 


Wa  can  dataralna  tha  continuad  parfdnaanca  of  $yttm*  only  by 
parforal;i^  yacond  araa  statistical  procaduraa  which  dataralna  tha 
raaction  of  initially  (ood  ccAponents  undar  oontlnuad  usa.  This  la 
Uia  only  trua  dateroination  oi  rallabilltyf  ainca  raliabllity  la 
neasurad  only  by  tiie  probabilit/  of  satisfactory  caatinutnd  usafa. 


Tha  first  araa  procadura  axaaines  only  tha  prasant  dafaetiva 
content,  while  wa  should  be  observing  Instead  tha  {ood  eoaponanta 
for  their  continuing  reaction.  It  Is  apparent  that  flrs~.,-afaa 


which  w^ra 
act  ro^atlor 


aetarmir 

control 


Second  araa  procedures  Involve  all  sorts  of  destructive  teats » 
Ufa  tests,  stability  tests,  ate.  to  dataralna  If  tha  eoaponant 
will  vltlisUnd  spaciflad  usage  for  a  eortaln  tlaa.  In  this  araa 
we  have  no  choice  out  to  usa  statistical  procedures  for  wa  cannot, 
even  If  we  wish,  test  100^  of  tha  product  »  wa  cannot  test  It  to. 
destruction  either  wholly  or  partly  and  usa  it  tool 


,  ■  ■  a 

Both  AQL  and  AOQL,  as  useful  tens  and  aaasurat  In  tha  first 
area,  have  no  physical  aaanlng  or  measure  in  tha  saeced  area,  for 
example,  we  could  htspect  a  lot  either  by  sampling  or  complete  ln> 
spaction.  end  determine  that  this  lot  had  a  vary  low  A^L  and  skis 
vary  satisfactory.  This  AQl  states  that  a  lot  probably  eoatains  a 
vary  low  and  satisfactory  percent  of  dalectlvas  at  this  particular 
aoaent.  But  this  has  no  relation  to.  and  Is  no  maarura  of,  whathar  . 
this  lot  will  have  a  high  unsatisfactory  rata  or  a  low  satisfactory 
rate  of  developing  addit.lonal  defectives  as  w«  use  It.  We  need  to 
express  a  rate,  not  a  percent.  And  since  a  failure  rate  involves 
tine  as  a  factor,  while  percent  defective  does  net,  we  find  the  .  . 
physical  terms  must  be  expressed  in  different  fundasantel  units, 
and,  therefore-,  cannot  be  directly  related  one  to  tha  other.  ■ 
ifevortheless,  wo  ct^oaonly  extend  tl>e  AQL  label  to -lire  testing. 

Ve  do  this  by  noting  tha  sanple  size  WiVi  allowable  failures  (In 
an  arbitrarily  fixed  tine),  on  the  life  test,  and  use  existing 
first  area  tables- to  find  the  corresponding  AQL  value.  Mll-STD-105 
is  ccffimonly  used  for  this  purpose.  Such  a  val-oa,  hcwe-/«r,  whan, 
applied  to  life  testing  has  no  physical  meaning  cr  measure  «-  It  Is 
.*t  best  only  a  hatvly  label  to  distinguish  one- life  test  from  another. 
Typically,  a  statement  that  the  exercise  of  an  acceptance  test 
iiavijig  a  saapl#  size  of  1?0  tubes,  and  an  acceptance  s-raber  of  3 
tubes-  assures  that  a  lot  of  2000  tubes  has  a  controi..«d  quality 
Boftswred  by  an  A-QL  of  0.65.  But  the  0.65  AQL  statement  for  this 
lot  has  no  obvious  relationship  as  to  whether  these  rube;  will  or 
will  not  work  vatirfsctorily  for  50  .hours  in  an  air-craft  employing 
.lOOO  tubes.  We  any  leave  the  tube  user  h-lghly  lapresso-i  by  these 
authoritative  aeasures  of  quality  control,  but  If  the  statsmients 
were  mad?  In  Ssnscrlt  they  wuld  be  no  less  useless  to  the  user's 
need  to  evaluate  reliability. 


We  need  t-o  express  acceptability  of  a  product  in  terms  of  a 
criterion  which  wa  can  best  lebrl  an  AccapUble  Failure  Kate  (AFS) 


r*th«r  than  the  criterion  of  Acceptable  Qxialitp  Level  (AQDy  6<M* 
■only  used  in  f^rst  area  aeeaptanee  procedures.  Aa  ATR  aliht  be 
derived  tc"  any  particular  case  by  noting  the  value  of  AQL  that 
eould  be  associated  with  the  saapie  site  and  aeceptance  maber  to 
bo  used  for  life  test:  and  dividU^  that  value  of  AQL  by  the  total 
specified  life  lest  tiae,  in  order  to  obtain  aa  average  failupo 
rate  that  ve  could  label  the  APR  for  that  test.  Ihls  process 
aight  have  aerit  in  KlloviAr  one  to  uaa  existing  first  area  pro* 
eadu.*a  sanplir^  tables  for  second  erea  procedures}  but  aa  find 
when  ve  ex&aine  the  subject  in  sose  detail  that  such  a  siaply  do* 
rived  AFH  nay  not  adequately  express  our  needs,  and  nay  be  quite 
aisleading  when  we  attoapt  to  evaluate  or  control  reliability  by 
its  use. 

Tbo  chance  for  successful  aquipMant  operation,  'v  probable 
fraction  of  total  equipaonts  operating  as  required,  vdien  using 
coeponents  having  ca ctly  fs  IIutm,  .on.-Ura.  tftlt  ie  given  by  tbo 

generalised  expression: 


a- 


^'°p(o,h/T.,f)p(r,ntf)jf 

rp(»;ntf)<if 


where: 


T  ■  hours  of  failure  free  operation  required. 

M  ■  nusiber  of  coaponents  used  in  oquipaient. 
t  •  hoars  of  coepooent  operation  on  life  tost* 

0  ■  nuaber  of  eoaponenta  testod  on  Ufo  tost. 

.  r  a  ntnber  of  coaponants  which  failed  oa  life  teat. 

■  •  severity  of  use  factor  (where  a  ■  1  for  the  appUesblo 
life  test). 

f  •  coaponent  failure  rata. 

The  expression  P(0,VSaf)  is  the  probebility  of  anjoylng  sero 
feilure^  in  an  aquipaant  which  uses  a  certain  nuaber  of  conponants, 
W,  for  a  certain  tlae,  T,  at  a  certain  severity  of  usage  level,  a, 
when  the  failure  rate  of  the  coaponents,  f,  is  taken  as  an  inda- 
pendant  peraaetev. 

Since  we  can  never  know  absolutely  fruo  fellur*  rate,  f, 
froa  any  practical  sire  of  test  saapie  or  field  use  staple,  we 
eust  eaploy  e  probability  distribution  to  calculate  froa  the  Infor* 
rstloi  %-e  have  the  most  probable  value  of  between  f  *  0  and  f 
Ihis  probability  distribution  ir.  contained  in  the  expression 
p(r,ntf)  in  the  equation  above. 

If  we  make  the  assumption  tl:at  the  observed  failures  contri* 
butlng  to  the  value  of  X  occur  individually  and  collectively  at 
randort,  we  may  use  Poisson  distribution  functions  for  sufficient 
accuracy  at  the  reliability  levels  and  uses  which  are  of  interest 


PS 
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Uh*.i  Equation  (1)  la  avaluatad  by  uaa  of  Pclaaon*  dlatrlbu- 
tlonst  wo  darlva  an  axpraaslon  usabla  In  arlthaatic  taraat 


( — — ’V  ** 

nt  ♦  irai  y 


(2) 


Tot  alapllflcation,  and- to  poralt  .'«tar  calculation,  wa  can  eon- 
bine  terna  of  {2)  in  a  ratio,  which  wa  will  call  the  taat  ratlot 


nt 


(3) 


irca 


and  this  penal ts  wrltioc  thr  equation  for  in  tents  of  q  and  r 
alone: 


(W> 


Equation  (•<)  e;(presses  the  value  of  probabfllty  of  successful 
e<iuipraent  operation  In  terns  of  .observation  of  ^xnctlv  r  fslluJres 
per  saapla,  no  more  or  less. 


This  Is  Seldom  our  situation  when  we  are  operating  with  specl« 
flcatJons.  particularly  tha  present  JAJI  or  MIL  specifications  which 
rnqulra  life  tests  of  n  components,  for  a  period  of  t  hours,  with 
no  more  than  c  components  allowable  as  failures.  .That  Is,  wa  now 
require  c  or  less  failures  per  s.aBple  and  ve  agree' to  accept  lots 
having  not  only  c  failures,  but  any  lessor  number  from  *ero  to  c. 


Equation  (4)  can  be  used  to  calculate  exactly  the  equipment 
reliability  from  an  exactly  observed  mtmbor  of  component  failures, 
but  If  It  is  desired  to  r^ate  equirsaont  reliability  to  component 
specifications  certain  assumptions  and  mcdlf lea tions  must  be  made. 


Three  assumptions  might  be  made  —  most  p'assialstlc,  that  ell' 
received  components  Just  oaroiy  meet  c  feilores  per  lot,  —  mos.t 
optimistic,  that  ail  raceived  components  iiave  zero  failures  per 
lot,  --  or  third,  t.*:at  various  lots  have  passed  t)ie  tests  with 
observed  fa  1  lures -rar^ing  from  r  =  0  to  r  »  c,  "’he  assumption 
must  bo  made  in  the  tnlrd  case  tn«t  any  one  value  of  c  is  Just  as 
likely  to  occur  in  the  range  of  C  to  c  as  any  other  value,  ar^i 
althoogh  experience  teacr.es  th*t  tliero  are  unlikely  to  be  equal 
proportions  cf  lots  at  all  levels,  Uia  third  assumption  is  as  good 
as  can  be  made  with  the  inf./n-atlon  at  hand  from  a  specification. 


«o  will  usf"  throyvh''-ut  ‘he  F'!?'"'’.  list rihu*  io''  rnthr-r  thar;  th<* 
r.ore  e-fAct  blnctrJal  tbr-'-r-  r  r:  as  the  arr.u’’n<:y  r-o 

obtaltie'i  Is  g-T.e rally  s':f'".'c'.vnl. 
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with  this  sssusptlon  V*  cut  no**  Modify  Sqiutloa  <1)  to  pro* 
diet  <f4uiio<nt  rallsbUtty  in  tonM  of  eooponsnt  spoelflestlohat 


Sc- 


S'’p(o,NTmf),Cc.nt-f)jf 

- -  - ' — 


whor*: 


Sg  =  chance  of  sueesssful  •quipnant  operation,  or  probahlo 
fraction  of  total  equlpoenta  operating  as  required, 
^  ^,.wt’,«n..U5lri3.£v.v;p..'n'>-t?.->crln«  c  or  less  failures  on 
life  teat. 


c  =  tcceptaoca  nuaber  on  specified  life  test. 

Evaluation  of  Equation  (5)  by  use  of  Poisson  distribution  givest 


Sc- 


NTm 


I 


C  -Hi 


(6) 


which  nay  also  be  written  In  tarns  of  q  and  c,  as  previously  for 
Equation  (1),  thus*  .  f 


X 

Ctl 


^(X.) 


(7) 


Figure  4  shows  the  relationship  of  to  q  and  c  graphically. 

The  test  ratio  q,  which  Is  used  In  the  equations  above,  Is  a 
quantity  which  neesures  the  relative  amount  of  component  testing 
perfonoed,  In  terms  of  numbers  cf  coapon^nts,  anl  hours  of  opera¬ 
tion  adjusted  for  a.  severity  of  use  factor,  in  relation  to  the 
component  -  hour  require^sents  -of  an  &ni  oqutcsor.t.  Wiien  q  is 

w  have  done  relatively  little  testing  and  hove  relatively 
iltUe  Infcraation  about  coaponent  quality  for  the  intended  appli¬ 
cation  for  which  q  was  computed,  bhen  q  Is  large  we  have  done  a 
relatively  large  ancunt  of  testing  and  have  obtained  a  relatively 
large  amount  of  Inforeiatlcn  about  component  qualltv,  since  q 
depends  or.  both  the  parameters  of  an  acceptance  test  and  the 
parameters  cf  the  intended  ussre,  the  assurance  of  success^l 
^ulpnrtn*  op-ratlcn,  £^,  t-ecoaes  larger  and  larger  as  we  increase 
the  value  of  q  and  keep  constant  the  acceptance  number,  c,  of 
allowable  test  failures,  ’ 

Vltliln  the  Alaits  of  ecciicoilc  -nd  equlpoent  practicality  .we  ' 
cannot  continuously  Increase  our  conple  size,  or  the  value  cf  q 
a-u’-e,  to  gat  greater  a..a  greater  as-junts  of  infor3ati.3n,  yet  we 


irvfev  JSa'tJU.'titrt  *-  fc-  'T  ■.  a  • 


mist  obtain  this  infonuitlon  If  «»  ar«  to  hava  absolata  assiiranca 
of  raliabllity.  This  dllasua  posas  eartain  altaniativasi 


A.  We  can  lower  the  severity  of  use  factor,  a,  by  more  eon* 
servative  use  of  the  eoaponents*  This  aay  pose  probleas  of  equip* 
■ent  size  or  veifht,  or  other  undesirable  factors. 


B»  We  can  be  satisfied  with  lesser  values  of  the  assur* 
ance  of  .'uceess  function.  This  has  raziif lea  tlons  In  the  laportanca 
and  cost  of  missions,  but  may  be  somewhat  offset  by  preventive 
maintenance. 


C.  We  can.  Increase  the  severity  of  life  testinc  by  the  use 
of  Increased  acceleration  factors,  so  as  to  get  more  Information 
from  a  smaller  number  of  samples  in  shorter  time.  Febst  (Reference 
7)  has  shown  a  method  of  statistical  test  design  to  obtain  aaxlaua 
inforsiatlon  from  alntmum  samples.  We  already  use  aeeeleratad  tests 
on  compononts,  but  as  shown  elsewhere  In  this  report,  we  do  not 
know-  very  much  about  the  acce.leration  factors  for  most  parameters, 
or  the  Inter  relationstilp  of  the  multitude  of  environaental  and 
perforaance  factors.  Accelerated  tests  are  common  In  other  fields 
of  engineering,  and  we  must  in  time  learn  the  ratios  and  extent  of 
acceleration  of  various  factors  lit  electronic  component  testing  as 
related  to  actual  usage* 


D.  V'  can  apply  o;ir  statistical  techniques  to  many  past  lots 
of  Oumpoae,.t,s  to  predict  the  perfomance  of  the  present  lot*  This 
can  be  done,  however,  only  when  the  production  is  sufficiently 
continuous  to  produce  reasonable  unlferaity  from  lott  to  lot,  and 
is  "in  control";  This  is  tne  technique  of  "process  -  average’’ 
quality  control  which  is  infinitely  preferable  to  any  slngia  lot 
or  random  lot  data.  . 


£.  We  may  employ  the  field  usage  of  the  compeneots  themse.vaa 
to  set  up  a  feed  beck  loop  for  continuous  product  control  and 
acceptance  of  product.  This  procedure,  however,  is  extremely  dif> 
ficult  in  military  practice,  and  the  rate  of  information  feed  back 
will  probably  be  too  slow  to  control  components  produced  in  limited 
quantities. 


Whichever  of  the  above  alternatives  is  chosen,  it  will  affect 
In  the  end  only  the  value  of  the  coeposite  parameter  q,  and  of  the 
value  c.  The  general  relationships  above  will  In  any  case  express 
the  CCS  tint  acceptance  procedure  which  must  be  used  as  they  are 
fixed  by  tile  rellebility  requirements  of  the  user  of  the  equipment. 


As  we  attempt  to  reduce  ttiC  amount  of  testing  to  bo  done,  wt 
could  do  so  with  easier  mind  if  we  could  know  definitely  the  con* 
fidence  which  could  bo  placed  in  aay  given  level  of  performance 
desired.  Some  further  »anipuIatlon  of  the  equations  above  will 
help  US  to  derive  a  -figure  of  "confidence". 


Prom  the  shape  and  nature  of  the  curves  in  Figure  4,  we  ere 
led  by  the  apparently  constant  ratio  of  c/q  to  the  expression  of 
Sc  as: 


I  Vi- 


A  i-*W  iTIf  IT*  V* 


\il\nm  Kq  Is  •  factor  which  adjusts  •  thsorstlcal  «zpr«stlon  for 
ideel  rallabllltyt  to  an  sxaet  «aluo» 


WO  can  dariv#  aat 


Tha  value  of  Is  near  unity -for  aost  values  of  e  and  ■ 
except  when  e  or  4|  or  both)  are  iaa.U. 

the  portion  of  Equation  (B)  within  the  traekats  is  tha  equip* 
nent  reiiabilil/  prediction  under  ideal  test  eonditionSf  where  we 
have'  enployed  an  infinite  size  test  of  q  *00.  Ihe  peraaeter 
adjusts  this  idealistic  value  of  5^  to  lousr  resultant  values 
based  on  practical  values  of  q  and  e  for  tests  which  do  not  gener¬ 
ate  1C0)(  confidence  in  our  results.  The  peraaeter  Is  thsrsfore 
A  confidence  factor.  We  can  choose  values  of  q  and  c  to  give  ue  * 
any  desired  degree  of  confidence  in  the  test  result. 


The  equatior  variations  above  hav.  expressed  reliability 
predictions  in  tarns  of  specifications,  csicnlatad  by  ^  use  of 
paraaeters  c  and  Sr.  We  can  sat  up  siallar  axprassions.  to  ralate 
1 -liability  pradictions  to  obsarvad  data  frca  testSf  using  the 
original  paraaeters  r  and  S^t  as  follows^  - 


whers  S^i  exprauscs  the  idealised  valua  of  reliability  froa  in¬ 
finite  q  test  s.tze( 


and  K  is  the  confidence  factor  ve  say  have  In  our  practically 
limited  observations. 
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k-r 


Koto  th*  ld«ntlty  of  form  of  Baootlan  (11)  with  tho  oxproition 
R  >  usftd  in-  th«  Mrly  port  of  thlt  MCtlont  to  «t«t«  roll* 

sbllity.  Whtt  a  long  way  ««  hatro  aoaa  to  raaliaa  tha  Inmlidity 
of  such  axprasslons  in  practical  easasi  and  tha  realistic  raqu::ra- 
nent  for  the  confidance  factor  Kf  lha  use  of  such  imodlfled 
reliability  factors  can  lead  only  to  over  optlalstic  predictions 
and  disaster. 

The  fonts  of  expression  for  equipaent  reliability  predietiont 
for  Sc  it  and  for  St  it  can  be  put  Into  other  useful  fonts.  To  do 
this,  wc  need  to  recognize  and  define  several  sorts  of  failure  rates. 

First,  a  lot  of  coteponents,  operated  under  a  single  set  of- 
defined  conditions,  undoubtedly  has  en  ectual,  inherent,  failure 
rate,  and  we .have  used  tha  sycbul  -f"  to  syabolisa  thisrate.  The 
rate  may  be  quite  variable  with  tiae  of  life  or  component  ape.  or 
may  be  quite  constant  in  many  practical  cases  where  we  deal  with 
constant  fsilure  r.ate  mecnsnlsms.  In  any  ease,  the  failure  rata, - 
f ,  symbolizes  the  actual  instantaneous  fallttra  rata.  For  any 
actual  lot  of  components,  we  can  nevar  know  this  trua  failura 
rate,  but  can  only  estimate  it  from  observation.  The  accuracy  of 
estimate,  as  we  have  observed,  is  poor  when  we  collect  but  little 
lnforna*^ion.  Thuj,  when  we  try  to  evaluate  an  instantanaous 
failure  rate  by  observation,  where  the  time  period  of  observatioo 
Is  very  shc't  or  approaches  zero,  we  collect  exceedingly  little 
Infcrmation,  and  our  confidence  in  our  calculation  approaches 
zero.  In  practice,  we  must  collect  information  over  .consldarable 
time  periods,  even  wtien  we  observe  considerable  quantities  of'  com* 
ponents,  In  order  to  have  any  reasonable  confidence  in  the  ecrjacy  . 
of  the  numbers  we  calculate.  When  w«  so  observe  over  a  consider* 
able  unit  period  of  time,  we  eaouct  escribe  the  observed  Individual  . 
failures  to  any  time  period  shorter  than  the  unit  time  period,  and 
retain  the  desired  confidence  in  the  result.  '  . 

During  a  unit  time  period,  t,  we  may  symbolize  the  total  . ’ 
failures  as  r  from  a  lot  initially  numbering  n  components.  The 
estimated  failure  rate  which  we  say  computs  from  these  values  is: 


.  (13) 


This  is  some  sort  of  average  failure  rate  over  the  entire 
unit  time  period,  but  calculated  by  dividing  by  n,  the  initial 
sample  size.  Actually,  uie  sample  size  varies  during  the  period, 
ending  with  n  -  r  components.  Ve  cannot  have  cnoi;gh  Information 
at  a  desired  confidence  level  to  tell  how  it. might  truly  vary  for 
the  lot,  rather  than  the  sample,  throughout  the  perlcd.  We  can, 
however,  make  a  roa3otw»bi6  as3ua?tlcn,  which  Is,  that  In  the 
absence  of  infortflatlon  to  the  contrary,  the  true  failure  rate  is 
con.it.ant  at-  least  tJiror^;hout  this  unit  tie*  period,  and  that, 
according.ly,  ine  surviving  populstJon  follows  a  dac. easing  exponen¬ 
tial  life  curve  during  Uie  unit  time  period.  If  we  define  the 
e.sUaatert  as  suae-’ -constant  failure  rate  as  tlien  we  may  write 
wti  ^rc  * is  'lie  estlthated  assumed— constant  failure  rate  for  the 
unit  tli-f'  period. 
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'  "*  ^  (15) 

Te  u^ 


^  orUlMl  saaplt'Khicb  f»iia  4url^ 


T»bl«**^l!'***  c«-lcal*u«  ryo«  SiiUBtton  (15)  «r*  9baim.in 


tASIl  I 


0 

0.01 
0.02 
0.05 
0.1  ■ 
0.2 
0.3 


1.000  ■ 
1.0C5 
.  I. CIO 
1.C2S 
l.C5*» 
•1.116 
1.129 


o.a 


uzn 

l,3B6 

li527 

1.7.20 

2.012. 

2.558 

•C 
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I*'  *-"-9^  w  f«llur#  «:#  upwiw!  fr«  th*  slapl«  * 
*  o.  E^.-^lc.n  Uh)  by  ::f.  Cri*  *  or  calcuHt^  »S  u»»' 

V  '^■'  f.-  in  s*ner«l, 

for  .u/- 
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r«t»s,  such  83 


v«  •xsilr.e  Itt^r. 


•»nt,  not  oni/  for 
for  ctl>er  f«iluT* 
aay  ur.visual  esse, 
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Wh«n'w«  u««  KnufiticR  (^}«  M  My  conblm  It  with  EqitMtion 
(3)  tiid  find: 


t 


tl7) 


and  vw  My  furthar  cowblna  thla  with  Equation  (11)  and  find: 


(18) 


Slnca  tha  conpaslta  paraBatar/  f^KTiii  1$  tha  aitiMtad  numbay  of - 
failures  wa  vuuld  expect  to  find  In  the  aqulpnont  yiiao  uslnt  oo«> 
ponents  havlr.;  an  astiaatad  failure  rata  f..  wa  nlfht  note  tha 
astloated  to>l  -aqalpuant  failures  during  tiaa  T  to  ba: 

•fe  WT m 

^  (19) 


Than: 


Sri.*  ^ 


-5e 


(20) 


This  'xprasslon,  wlUi  various  sysbols,  and  In  various  forms*  has 
bean  published  as  an  aqul]:ti:ent  reliability  prediction.  It  ISf 

but  Kuat  be  BU 


"hcvcvsr  I  5^‘ 


correct  Jr  c^^Tilcte  In  itsi 
^7.  f.! 


by„the  Cvnrtder.ca  factor.  rT.  from 


If  wa  consult  a  Ufa  test  specification,  which  specifies  a 
naxlaua  r.mber  of  allowable  failures  (tne  acceptance  nunber  c)  for 
certain  sample  sizes  and  operating  tines,  than  we  asy  calculate  a 
ratrtd  saxlaua-aUrvable  failure  rata  froa  these  figures.  The  cal¬ 
culations  say  beeose  somewhat  involved  In  cases  where  the  sample 
nunbet  of  c.vapor.er.ts  is  required  to  be  varlel  during  life,  or' 

V..f”e  a  failure  during  a  certain  period  will  be  arbitrarily  counted 
as  being  at  sore  arbitrary  tlae,  or  where  one  sort  of  failure  is 
given  ii.re  vstgr.t  Uwn  8ncth./r,  or  for  various  other  circumstances; 
tut  these  sljustacr.ts  are  details.  To  maintain  simplicity  of 
troatjcoi.t,  ve  calculate  only  an  average  failure  rate  based  on 
total  all.wslle  I'alljres.  Tills  we  symbolize  as  fa,  for  rated 
USX  LsuB-a  li;- ws  tie  failure  rate.  Then; 


(21) 


1 


m  \  ••  l/rflATiJfcf  L  ^  UkT.  ^  VA. 


a^v  1-^  tH*  lAs 


for  the  sia.-le  seset  tmadjusted  far  eosplteeUoQ  «•  dltca«scd  ebove. 
We  may  derive  from  this  relationship  that; 


(22) 


where  fm  la  the  reted  maxlmm  ellcwmbla  failture  rate. 


(23) 


whleh  expresses  the  probability  of  successful  equipment  operatioa* 
when  the  test  is  presused  to  be  100  percent  edei;uate,  or 
The  expresslMi  of  K<;iMtlon  (22)  contains  only  terms  which  relate 
to  usai;e,  and  to  rated  oaxlnua-allovajsle  failure  rat»  (fa>  as 
taken  from  a  specification  or  data  sheet. 

The  composite  parameter,  *  sl^pla  aeanir4.  It  is 

the  total  niaber  of  failures  wu  would  expect  to  find  in  the  e<;ulp» 
mont.  if  we  vers  to  use  components  all  having;  failure  rates  exactly 
equal  to  the  rated  aatlaus -ellovable  failure  rate.  .Ui  may  con¬ 
veniently  five  this  coppcsite  paraeater  in  6  single  symbol^  tl.us; 


(24) 


where  Rq  Is  ti-je  r.-r: 
sent  using  X  coup  or. 
when  fm  is  the  cos? 
tlon  (23)  as; 


ber  of  failures  we  expect  to  find  tn  the. equlp- 
•ents  for  tine  T,  at  severity  cf  usage  factor  mi 
o.nent  failure  rate.  Then  w»  say  rewrite  "iqua- 


(25) 


r.'fpp 


This  functlo  .  is  cocputed  in  Table  2 


TABLE  2 


B 

f£l 

B 

0 

1.00000 

0.1 

0.95163 

0.0001  . 

0.9999? 

0.2 

0.9063» 

0.CX>02 

0.99990 

0.5 

0.7869^ 

0.0005 

0.99975 

1.0 

0.63212 

0.001 

0.95950 

2 

O.V32.)3 

0,002 

0.99900 

5 

.  0.19865 

0.005 

0.99750 

10 

0.10000 

0.01 

0.99502 

20 

0.05000 

0.02 

0.99007 

50 

0.02000 

0.05 

0.975‘»2 

100 

‘  0.01000 

7h«  values  of  Spi  aa  uVen  froa  Table  2.  or  eoaputed  from 
Equation  (25) «  are  the  oaxlaua  equlpaent  reliabilities  w  alsht 
exi-ect  If  our  tests  were  Ideal.  All  the  values  above  must  be  aal- 
tlplled  by  the  factor  K/».  froo  Equati'oix  ii2}  to  account  for  the 
imperfect  confidence  we aay  have  In  practical  test  specifications. 

As .we  exanlne  the  considerations  above,  that  predicted  equip*' 
aont  rellebillty  depends  both  on  the  confidence  factor  end  on 
the  ideal  reliability  .factor  scl*  ve  note  that  tests  using  low 
values  of  c  produce  relatively  low  Xg  but  relatively  high  s^ii 
llltevlse.  test;,  using  high  values  of  c  produce  relatively  high  Kc 
but  relatively  low  Sci.  There  is  an  optiiaua  value  of  c  for  every 
possible  value  of  q  v*e  sight  encounter  that  will  produce  a  sost 
effective  test  result.  If  we  choose  c  too  low,  .tha  Indicated,  ideal 
failure  rate  'say  be  good,  but  If  Xc  is  low  for  this  east,  then  we 
hsve  esplcyed  «  relatively  inade.iuate  test,  and  the  low  confidence 
iix  our  Information  lovers  predicted- equlpsert  reliability.  Here 
we  have  brought  loss  confidence  in  the . apparently  jood  result  than 
ve  can  logically  Justify'. 

If  we  choose  c  too  high,  the  confidence  we  have  In  our  Infor* 
nation  may  be  vety  high,. but  perhaps  unjustifiably  high  If  se^  la 
calculated  to  be  low.  Here  ve  have  bought  a  more  expensive  test 
and  more  confidence  than  we  .say  Justify  for  the  relatively  low 
quality  of  components  under  consideration. 

The  optimua  value  of  c  is  thst  which  producee  equal  values  of 
y.Q  and  Scl  f^f  -ach  case  under  consideration.  'When  ve  calculate 
this  value  of  c  to  make  »  sci.,  f-or  various  values  of  q,  ve  find 
*J;at  c  is  usually  a  fractional  nuober.  Since  c  in  practice  nuat 
be  an  intcgi-«l  number,  we  pick  tha.  integral  value  of  c  which  most 
nearly  makes  Kc  *  scl  for  vaiious  ranges  of  q.  Tlie  result  is  shown 
in  Table  3* 


'When  q  is 

TABLE  3 

but 

then  optlatn  velue 

larger  than 

sBaller  than  ’ 

of  c  is 

0 

0.178 

0 

0.178 

2.70». 

1 

2.70h 

•O 

2 

There  are  no  cases  where  we  find  it  logical  to  devise  tests 
requlrit.,;  more  than  tws  failures  as  an  acceptance  number.  All 
such  te.st.s  fTi-vide  more  confidence  in  the  Inforxjation  produced 
than  Is  jujrtifled,  sln-ce  ve  sra  already  sufficiently  certain  that 


tJV'-S-'-'VO*  IT* 


predict*!  relleblllty  Is  Halted  as  calculated  by  the  use  ef  e  •  2 
and  the  value  of  q  under  consideration.  There  Is*  for  exaapl*(  ae 
logic  In  having  a  99*^/100  percent  confidence  that  predicted 
equipaent  reliability  Is  only  $0  percent.  Likewise  vt  should  not 
use  less  than  c  ■  2  as  an  acceptance  nuabery  when  c  •  2  Is  indl* 
rated,  since  that  would  be  equivalent  to  the  poor  logic  of  having 
only  a  $0  percent  confidence  that  our  coaponenta  ara  99-'*V/100 
percent  reliable. 

-  If  we  device  tests  having  vsluas  of  e  other  than  aa  Indicated 
in  Table  3,  we  produce  either  lnadeq>iate  or  excess  Inforaetlon  In 
coBparlson  with  than  indicated  on  a  logical  basis.  Vs  ara  aitber 
undertesting  a  good  product  or  overtesting  a  poor  product. 

We  aay  readily  calculate  for  Interaedlata  values  of  q  the 
corresponding  values  of  Se  for  each  rang#  In  table  3.  These  results 
nay  best  be  displayed  In  three  figures.  Usually  we  .will  wish  to 
choose  a  value  of  s^  to  aeet  a  desired  usage.  Therefore,  these 
curves  ere  dra.m  with  s^  as  an  Independent  pareoeter.  ana  once  Its 
value  Is  chosen,  values  of  c  end  q  ere  deteralnad  uiiiquely* 

Figure  5  displays  all  eases  ‘^hert  the  optlaun  aceeptanea 
nuaber  e  *  0.  On  this  curve,  values  of  sc  range  froa  se  *  0  to 
Se  ■  0.05.  Flgiu**  5  will  cover  all  cases  which  we  Bight  label  low 
reliability  cases,  and  it  is  labelled  as  Relleblllty  Range  L.  The 
end-of -range  value  of  s^  ■  0.05  does  not  quit*  agree  with  TUM.*  3  « 
we  have  chosen  a  roundea  value  of  se  Instead  of  an  exact  value.. 

Flgtir*  6  displays  ail  cases  where  tha'optlaua.  ecceptanea 
number  e  •  1.  On  this,  curve,  values  o-f  a~  range  froB  Sq  «  0.05  to  ■ 
Sc  >  0/5t  (rounded  values}.  Figure  6  will  cover  all  cases  which  w* 
Bight  label  laedlua  reliability  cases,  and  It  is  labelled  *s  Reli¬ 
ability  Range  M. 

Figure  7  displays  ell  cases  where  the  optlmua  acceptance . 
nuaber  c  -  2.  On  this  curve,  values  cf  sg  rang#  fro«  Se  •  0.5 
(rounded  value)  to  sc  *  1.  Figure  7  will  cover  'cases  whldi  we 
Bight  label  high  reliability  cases,  and  it  is  labelled  as  pli¬ 
ability  Range  H. 

Since  reasonably  exact  values  of  q  ere  difficult  to  reed  trtm 
Fl{,ure  7,  we  eiso  show  a  part  of  Range  H,  labelled  Rang#  HI,  In  • 
Figure  8,  wtjcre  sp  ranges  from  sc  •  0.5  to  se  *  0.95. 

Flgixre  9  shows  part  of  Range  H,  iabcXlod  Range  K2,  where  #« 
renges  frea  sc  =  0.95  to  =  0.995.  If  even  bl.;h#r  values  of  s« 
ranges  are  desired,  we  cay  aultlply  the  rig  it  land  q  scale  of 
Figure  9  by  any  power  of  10,  and  sisultanacusly  Insert  a  nuBber  of 
9  digits  eaual  to  this  power  of  lo,.  \i0f0r9  the  decimal  point  on 
the,  lower  (s^)  scale  of  Figure  9.  Thus,  Range  K5  would  show  s^ 
ranging  frou  •  0.99995  to  s^  ■  0.999995,  and  q  rattglng  froo 
q  *  20000  to  q  •  500000. 

These  five  figures  replace  Figure  '*♦  which  displays  Bost  of 
Its  Infonsotlon  In  ranges  that  are  far  froo  optlaun  for  test  purposes 

Rarely  will  one  require  the  use  of  Renges  M  or  L,  since  Reli¬ 
ability  Range  H  will  ur.'oslly  \©  found  deslrnbla  e'/en  for  non- 
crltlcsl  usages.  We  will  nearly  always  work  with  an  optteia 
acceptartce  ri'jaber  c  =  2. 


nw  ehole*  of  an  unvarying  aeeaptanea  ntaibar  appaara  to  ba  an 
ovaralaplifleatlon  of  aona  sort,  alnea  it  nay  flrat  appaar  that  wa 
taat  avarythlns  by  tha  a’ua  test.  ISila  la  not  tha  easO}  howavar* 
aj  can  bast  ba  shown  by  tha  foll<.win(  axaaplaa. 


Supposa  wa  dasira  a  taat  to  control  raliabllity  of  tuba  uaaga 
juaano  -• 


in  houaahold  radio  raeaivara,  vslng  X  «  5  tubas  at  a  aavarlty-of> 
usage  factor  a  •  0.2,  and  that  during  aaeh  T  •  ]00  hours  operation 
(about  one  wonth),  wa  desire  a  radio  faliabilit)  of  se  ■  0.921. 
Troa  figure  6  wa  find  that  the  required  test  acceptance  nvaibar 
0*2,  and  the  taat  ratio  q  ■  2?.  Frsn  Equation  (3)  wa  find  tho' 
value  of  tha  product  til  oust  be  nt  •  2500  tuba  hours.  Ua  sight 
tost  2500  tubas  for  one  hour,  or  250  cubes  for  }.0  hours,  or  par* 
haps  5  tttbas  for  500  hours,  allowing  but  two  failures*  For 
reasons  not  exanlned  in  this  naterlal,  tha  latter  choice  of  5  ■ 
tubes  for  500  hours  siay  be  aoat  practical,  •  and  it'ia  approxi* 
Mtely  the  test  applied  to  aany  tubes  intended  for  household  radio 
usage.. 


Suppose  wa  dasira  a  test  to  control  reliability  of  tuba  usaga 
in  a  business  eoapuxar  using  N  *  1250  tubas  at  a  savarity-of>U8aga 
factor  a  *  0.2,  and  that  during  aaeh  •  100  hours  operation 
(about  one  aonth),  ve  desire  a  eoaputar  reliability  of  s.  •  0.921. 
Froa  Fl'ure  8  we  find  that  the  requlrt.d  test  acceptance  ntubar 
c  •  2,' and  the  test  ratio  q  ■  25.  Frca  Equation  (3)  we  find  the 
value  of  the  product  aust  be  nt  •  625,000  tube-hours.  We  aight 
test  625,000  tubes  for  one  hour,  or  62,500  tubas  for  10  hotArs,  or 
3250  tubas  for  500  hours,  or  perhaps  25  tubas  for  25,000  hours. 
(The  latter  tiaa  is  about  .thrae  years.  In  the  interest  of  proapt*' 
ness  In  controlling  the  product,  this  would  be  ridiculous.)  Sup*, 
pose  wa  choose  a  test  of  1250  tubes  for  500  hours,  allowing  but 
tva:  failurts. 


In  tha  latter  ease,  it  is  apparent  that  wa  would  naad.to 
axoalna  the  use  of  the  five  alternatives  to  expensive  tasting, 
sinca  the  test  quantities  indicated  would  result  in  prohibitlva 
test  costs  If  undertaken  to  assey  or  control  slx^gle  lots. 


In  Bost  of  the  previous  aaterial,  w«  have  taken  .the  point  of 
view  tliat  each  user  Bight  calculate  an  appropriate  test  froa  know¬ 
ledge  of  his  particular  eeonoaic  and  reliability  require«snts,  and 
he  sight  transmit  the  values  associated  with  such  a  test  to  e  pro¬ 
ducer  or  3  specification  strndardlsatlon  group  to  be  put  to  use. 
Since  there  are  usually  a  eultltude  of  users  for  any  single  cob-  . 
ponent  (each  user  having  widely  varying  roqulreaents  of  quantity 
of  coopone.its,  time  of  us-  ,  and  severity  of  use  factor)  it  is 
apparent  that  a  producer  night  be  faced  with  an  unreconcllable 
range  of  test  rc.,i  Ireoents,  ranging  perhaps  oyer  a  1000  to  i  range 
or  aore,  all  for  the  same  coaponent.  Xo  producer  could  sopo  with 
such  a  situation. 


The  practical  situation  Is  that  a  producer  who  produces  a 
certai'.  reliable  component  with  certain  aatarials  and  techrilques, 
wsuld  I  ind  he  should  te.it  M.s  reli»hle  product  by  a  test  havlrig 
the  optimuB  acceptance  nuol>er  c  ■  2.  Ke  would  fix  the  saaple  quan¬ 
tity  n  (and,  accordingly,  for  each  s«..arat«  user,  a  separate  U-st- 
ratlo  q)  at  the  highest  value  cons.’. ••tent  with  the  manufacturing 
techniques  and  aaterials  eoployed.  XctuoAly  he  would  fix  both  the 
sBjaple  site  n  and  clie  test  time  t,  so  tl^t  ve  would  have  n  value 
of  1^.  specified  for  this  product. 
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By  th*  mrels*  of  good  and  vlth  the  •i.d  of  aUtlt- 

tle«l  tools  to  provido  flgurss  on  which  to  base  good  Judgaonti  d  - 
producor  or  a  spaciflcstion  standardisation  iroup  oay  sat  an  Qi 
valua  consistant  with  tha  prcluet  undtr  eoasldaratlafi. 

Geopga  Lavonbach  of  Boll  Talaphone  Laboratorlas,  a  consultant 
to  Task  Group  No.  5.  has  provided  us  with  Figure  10  to  lllusti'ata 
the  tasting  it  would  ba  necessary  to  do  to  obtain  various  confidence 
levels  I  as  the  failure  rata  of  the  components  varies. 

By  use  of  tha  c  and  nt  values  encountered  on  a  specification* 
various  users  may  calculate  the  suitability  for  thalr  use  of  tha 
product  tastad  by  the  parameters  e  and  nt.  Many  users  may  fixvl 
the.  product  too  good  for  their  requirements *  end  they  may  pay  a 
higher  price  for  this  good  product  than  they  might  feel  Justified. 

If  so,  the  continued  presenta.bion  on  their  part  of  the.  need  for  a' 
lower  quality  product  at  a  lower  price,  may  induce  a  producer  to 
offer  a  cheaper  second  product  tested  by  a  lover  nt  value,  and  . 
which  product  may  be  manufactured  by  techniques  .aid  materials  con¬ 
sistent  with  the  lo-ver  nt  .valus.  Or  perhaps  s  user  ^o  finds  the 
product  too  goed  for  his  use  nsy  wish. to  usa  the  product  less  con¬ 
servatively,  t}^at  is,  at  a  nigher  savarlty-of-usa  factor  (m)  and 
thereby  enjoy  higher  perfornanca. 

Hai..^  »’.sers  may  calculate  that  tha  product  Is  too  poor  to  meat 
their  rei;,iblllty  raquiraments.  They  may  continue  to  present 
their  needs  for  a  higher  reliability  product,  perhaps  In  terms  of 
a  higher  nt  value  than  that  currently  available.  A  producer  may 
be  able  lo  find  improvements  in -technique  or  sutarlal  that  will 
Justify  a  higher  nt  value  I'or  a  second  product  of  higher  quality.  . 

ait  if  technique  or  material  improvement  cannot  be  found, 
then  the.  arbitrary  setting  of  a  high  nt  value  in  e  specification  • 
'will  not  produce  higher  rellebility,  contrary  to  the  belief  of  . 
some  advocetes  that  one  may  produce  reliability  by  .specification 
alone.  Tlie  result  .of  too  high  an  nt  value  is  that  a  lesser  frac¬ 
tion  of  the  product  of  unchanged  quality  is  passed  as  a  matter  of 
probability  by  the  ’stricter  test.  But  a  product  of  unchanged 
quality  continues  to  flow  to  the  user  the  user  receives  a  lesser' 
fraction  of  the  same  old  stuff,  aiul  a  greater  fraction  flows  Into 
•  the  scrap  can,  TJie  cost  of  the  higher  rejection  fraction  Is 
directly  a  producer’s  cost,  but  eventually  the  consumer  pays  tha 
bill  if  the  producer  stays  In  business,  A  conswer  who  dictates 
quality  into  a  product  by  tightening  of  a  specification  alone  has 
not  onl.”  raised  his  own  prices  for  a  product  of  unchar.ged  quality, 
but  he  has  also  paved  the  way  for  his  own  disaster  by  belie  ihg  . 
in  a  product  improvement  that  does  not  exist.  -  . 

Ihe  situation  above  is  a  cctarecn  one,  and  one  Impossible  to 
control  or  evaluate  wiien  product  quality  Is  Judged  on  a  lot-byilot  . 
basis.  The' examination  of  cont.lnulng  production  of  a  product  to 
detorolne  a  process  average,  Includlrig  the  effect  of  rejected  as 
well  as  accepted  lots  on  process  average,  Is  the  only  way  to  assay 
and  control  the  situation.  The  need  for  continuity  of  proQUctlon 
and  quality  evaluation  ha.s  previously  been  exaKined  as  one  of  the 
alternatives  to  exorbitant  test  costs.  The  general  methods  by 
which  one  might  operate  a  srociflcatlon  when  controlling  by  process 
average  has  also  been  noted  briefly.  We  now  emphasize  tfat  such 
mefncxls  are  nece.ssary,  not  only  from  an  economic  basis,  but  also 
ns  a  means  of  -"eventing  a  user  from  dnj'irlng  himself  by  attempts 
to  raise  qiality  by  writing  more  -.stringent  specifications  alone. 
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Strict  Jot  spoclflea  Claes  or  lot' inspection  clone  cannot  pro¬ 
duce  rellsbllltyt  but  they  asy  produeo  •Is-runderstandlnfi  hldh 
costs,  and  possible  Jlasster  to  e  product  user. 

In  Mteriel  In  this  appendix,  we  have  evolved  second  area 
acceptance  procedures,  involving  sample  sizes  end  acceptance 
numbers  of  e  radically  different  sort  than  those  developed  and 
used  for  first  area  accaptanee  proceduras'.  ' 

Vie  still  need  e  label  for  the  -/arlous  second  area  acceptance 
tests  ve  say  use,  and  this  lasel  should  have  a  relationship  to  a 
failure  rate,  rather  than  to  soma  percent  defective  value  such  as 
an  AQt.  Tliere  are  several  vays  of  settln*  up  such  a  test  label  In 
terms  of  failure  rate,  but  no  natter  which  one  we  use,  we  find  it 
sooevhat  arbitrary  for  two  reasons. 

First,  as  was  noted  in  developing  Eq;>atlon  7,  we  must  sake  an 
assumption  concerning-  the  distribution  of  lots  that  may  bo  received 
consistent  with  a  {Ivan  test  specification.  Wd  made  an  assumption 
lylaj  between  the  worst  end  best  performance  that  could  be  expected 
when  exercising  a  given  specification  In  order  to  develop  ^>iatlon 
(7).  Vfiien  the  acceptance  nusber  is  c  •  2,  we  find  the  assumption 
can  be  in  error  by  o  factor  not  exceeding  2  In  its  etffect  on  reli¬ 
ability.  Usually  the  asstssptlor.  will  be  much  closer  to  the  facts, 
but  there  is  nothing  that  can  possibly  appear  In  a  specification 
to  tell  us  how  good  the  assumption  may  be  except  that  actual 
average  quality  must  lie  beeveen  the  limits  of  ^0  and  2CO  percent 
of  the  assumption  we  make.  Thus,  wiien  we  set  u  failure  rate  as  a 
label  for  e  test,  we  may  be  off  by  a  factor  of  tw;,  but  usually 
mych  lass. 

Second,  should  ws  try  the  snme  unvarying  lot  of  eonponants 
In  varying  usages,  we  vill  get  somewhat  varying  estlsuted  failure  . 
rates  by  observation.  The  trua  -•‘allure  rate  vlli  be  observed  only 
when  ve  use  Uie  coaporisnts  In  an  equipment  using  an  infinity;  of  . 
components.  Even  In  trie  limited  life  *.est,  we  will  observe  a 
slightly  different  estimated  failure  rat#  than  the  Irna  failure 
rate  of  the  lot.  vdien  we  estimate  failure  rate  by  Bq'jatlon  (13) 

•or  Equation  (l*t;.  '  .  ‘ 

A  good  compromise  failure  rate  label,  not  exact,  since  no 
value  can  be  exact,  Is  to  define  an  Acceptable  Failure  Hate  (AFR), 
or  f^,  In  accordance  with  &v-“5lon  (26). 


For  t'xacplo.  a  test  with  acceptance  number  c  »  2,  sample  quantity 
n  ■  5,  snd  test  time  t  •  500  hours,  vould  result  In  f,  •  0,0006. 

The  test,  nowever,  will  also  pass,  with  ir.cvc’H'irfily  .•■nail  fi-rctlcn 
of  rejection,  lots  having  tma  failure  rates  of  f  =  0.00006  or 
f  »  O.CC0006  or  on  do’wn  to  f  «  0  (perfect  lots).  Tiie  teat  vlH 
nlso  pass,  with  conaldarable  fractions  of  rejection,  lots  having 
true  failure  rates  of  f  »  0.0"'-£  or  with  Increasing  fraction  of 
rejection,  f  =  0.0C6  or  f  *  0.06,  or  wsrso  yet.  The  chance  of 
passing  such  bad  quality  is  very  jcuai.l,  but  thesf*  chances  as  they 
affect  equipment  rellahlilty  cre-llcflcns  are  autfsnatically  calcu¬ 
lated  when  we  use  .E-i'aatlon  (7.  or  ?’_guro  *t  to  liateralne  sg. 

.'■Jany  other  attempts  to  develop  ond  simplify  iho  exiTesslon  of 
failure  rate  in  usable  for*  he'/c  teen  made,  ft;?  such  presentation 


*  yAath  Mr  b«  useful,  eltbouth  not  etetistlceXly  eccurete,  is  con- 
tslned  in  the  neport  of  the  RMVJt  Teak  Group  on  PrepersWoo  or  e 
Relleblllty  Definition,  end  la  entitled  "Oetenslnetloo  of  Pensls- 
slble  Coiponeiit  Pert  Pelltire  ReUa*.  This  report  dewlopes  i 
Bethod  of  ezpresslnc  reliability  the  ratios  of  failure  of 
various  coeponauts  to  one  another  are  knovn,  but  the  abaolu^in-  ■ 
dividual  failure  rates  are  unkcovn,  Pendlnc  a  tlae  ^an  sufflcleBt 
teat  data  la  available  to  provide  ate tlatlcally  va4.1d  faUwe  wUa 
for  Individual  eomponents,  this  nathod  $u**astad  by  the  lanu  Mini 
CocsDlttee  aay  be  useful; 
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Appllcatlonsi  ' _ 

Maximum  pressure  15. A  lbs. 
per  square  inch.  Minimum 
preeaure  12,5  per  square 
Inch. 

Airborne  Equiomer.t 
Appllcatlona: 

1956:  50,000  feet 
year  "A":  70,000  feet 
year  “B":  125,000  feet  ' 


Shipboard  k  Shore 
Applications; 

15G  for  11  milliseconds 
In  ell  3  planes. 
(Bslllstic):  300c  for  1 
mllllsscond. 

Airborne  Equipment 
Appllcatlou; 
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Shock:  Sea  level  to 
150,000  feet  in  I5 
nlnutea. 
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Strueturf'lly  trans. 
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quency  5  to  55  cps, 
double  amplitude 
of  .06*  or  100. 

High  frequency  55  to 
3000  cpa,  20c.  . 

Acoustical  (white 
noise  and  line 
spectrum); 

Frequency  35  to  1C,000 
cpa 

Energy  level  190'Jb 
(reference  level  „ 
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FO«>L  RE?OBT 
TASK  GROUP  NO.  0 


Th«  M-mber*  ot  the  Task  Oroup  agree  that  concerted  action  must 
be  taken  to  Inprove  the  reUiblllty  of  electronic  equlpawnt. 

The  Task  Oroup  believes  that  existing  laws  and  procureaent  x>agtt- 
latlons  are  adequate  and  suffloiently  flexible  to  enable  the  con¬ 
tracting  officer  to  obtain  fully  quCilfltd  producers  for  the  more 
important  electronic  Itens.  This  is  particularly  true  if  all  tech¬ 
nical  sei  vices  and  bureaus  unifonaly  interpret  and  isplement  OOK  arid 
POD  guidance  for  eatablishnant  and  salntenance  of  the  aobilixation 
base  for  reliable  electronic  equipment.  *  .  ' 

This  Committee,  therefore,  does  not  reeassaend  at  thistiae  any 
basic  change  in  the  regulations.  It  does, ' however,  strongly  recom- 
laend  stenuardlzation  in  the  interpretation  of  each  clause  in  the 
ASPR  legulatlons  between  all  of  the  procuring  services. 

The  Task  Oroup  is  convinced  that  reliable. electronic  equipment 
can  not  be  procured  unless  the  contracting  officer  can  incorporate 
in  his  proposal  a  comprehensive  set  of  technical  specifications  which 
if  met,  will  pi'oduce  the  degree  of  reliability  required.  Such  tech¬ 
nical  Bpeciricstlone  do  not  now  exist  but  Task  Comalttees  1  to  5  of 
AGREE  are  responsible  for  developing  the  framework  around  which  it 
is  hoped  such  specifications  can  be  written.  Given  these  speclflca- 
tlor.3,  the  contrsctlng  oifloer  has  the  procurement  tools  which  are 
necessary  to  ensure  improved  reliability.  These  tools  arei 

a.  Use  of  coat  type  or  rcdeterralneule  contracts  during  the 
initial  production  run. 

b.  Ability  to  contract  for  a  pilot  run  to  provide  for  extensive 
teats  prio-  tc  full  production. 


e.  Careful  aeleetlcn  c-f  highly  qualified  oontrastora  for  the 
aatabllahnent  of  the  aoblxlzatlon  baae,  ualng  a  quallflcatloA  procedure 
to  accurately  evaluate  the  aupplier'a  preaent  and  potential  capabi''ltlea. 

d.  Restriction  of  coispetltlon  to  planned  suppllera  once  the  base 
lias  been  established.  This  should  apply  to  subsequent  spare  part  pro> 
cureaent  as  well  as  the  orlglrel  end  equlpinent. 

e.  Provision,  If  necessary,  for  operational  tests  prior  to 
acceptance. 

f .  Provision  In  the  production-  contract  for  a  program  of  con¬ 
tinued  product  loprovement  baaed  on  controlled  testing  and  field  ex¬ 
perience. 

The  Task  Croup  recognizes  the  need  for  continuing  and  Increased. 

'  eophasls  on  programs  to  design,  develop,  production  engineer  and  mass 
produce  new  an  Is^roved  electronic  component- parts  and  materials,' apd 
the  writing  of  specifications  which  will  permit  the  end  equipment  manu¬ 
facturer  to  purchase  these  parts.  Inherent  reliability  In  these  parts 
and  mcterlala  will  have  a  material  effect  on  Improving  the  reliability 
of  the  end  equipment.  .To  summarize,  the  Task  Group  recommendst 

s.  -Continuing  action  to  Improve  technical  specifications, 

b.  Uniform  Interpretation  and  Implementation  of  procurement 
laws  and  regulations. 

c.  Tl'.e  use  of  a  comprehensive  qualification  procedure  to  ensure 
that  -cor.cracts  are  let  with  qualified  contractors. 

d.  Use  of  contracting  procedures  for  end  equipment  and  spsre 
parts  that  will  provide  optlm.«  conditions  for  insurance  of  reliability 
to  the  deg; ee  required, 

e.  Increased  c-iphasls  o.n  tr.e  use  of  improved  electronic  coaipunents- 
and  materisls. 

f.  r.  program  tor  product  Icprovcaent  as  3  phase  of  the  pro¬ 
duction  plan. 
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Tile  following  personnel  constituted  subjeci.  Tis!;  Group: 


Rcrris,  ChalriMn' 

Brown,  udq.  Air  K.terlel  Coaa-r.d 
Ouim,  Bireau  of  Ght;^s 
H.eKeraon,  Signal  Corf 
Tiicms,  Ce-.vrral  Electric  Co. 
McBirrott,  Ceiiersl  Electric  Co, 

0 ’Hanlon,  RCA 

Cunnir.jhfiB,  Raytiieon  Kfg  Co. 
HicKir.non,  Hugfiea  Aircraft  Co. 
Dunn,  Collins  ftjulio  Co. 

C  jrderain,  Vestem  Electric  Co. 


OASD{ .■>«.),  waihl.-t;to.'>,  D  C 
Wrleht-Fleld,  Cliic 
liasbinEton,  D.  C. 
Plilladelpbli,  Ps. 

Utlcd,  S.  t.  ■ 

Syracuse,  9.  1. 

Cusilen ,  N »  iT» 
baltb-us,  Hiss. 

ElSegtuido,  Cslifornls 
Cedar  ft&pliU,  loua 
Winston  Siilea,'  H.  C. 


Tills  Task  Croup  isjS  uct^'-'sted  in  July  i95^>»  Two  fonoal  aeetlngs  were 
held  in  W.oblng-.on,  D.  C.,  one  bn  July  2i,  1956  and  tbe  r-econd  on  Bovesber 
2?,  195b.  Uic  following  areas  were  cousidered  by  tbe  IbsX  Crorup  snd  deeoed 
tb*  acre  important; 


1.  Rtlatiosships  botwrn  the  designer  of  electronic  equipeent  .nd  tbe 
I'iok.-ging  encineor  in  order  tbit  ui.i'.gn.'!  of  electronic  eqaipaent  could  be 
}..-c;rriy  preserved,  packaged  and  pot'i.eu  aal  lu.»L  in  tbe  case  of  newly 
dcsignea  cquipacnt,  there  vou’d  tc  u  close  working  relationship  between 
these  two  iatei'cstb  duri.ng  tne  desigo  stage. 


livestlgations  indjc.atcd  tbit  while  In  the  past,  there  was  scoe 
luck  cf  cocnuiication  between  tbe  desl^ier  cf  tbe  cquipcjent  aod  the  pacVtig' 
ir.g  engineer,  tbnjugn  nanagencat,  curre.T.ly  there  in  the  interchange  of 
i.-.foiTntlon,  so  tniv  relations  are  good  and  there  is  no  longer  a  serious 
f rob lea  in  this  area. 


To.sH  Oioup  recoeDeads  that  wc.'kir.g  relations  between  the  etpixp- 
3»:it  designer  and  p-ici.agc  scwly.er  be  continued  and  Irniroved. 


3.  Industry  j’opreoeiitatives  piloted  out  there  is  little  infoni.tion 
on  cushl  .wing  to  duspi-n  djTUadc  forces.  Tills  problem  If  .Uso  cf 
.‘..ii  e:T.  t.i  the  i-ilitas-y  departments. 


Currently  the  Certnllr Ir.g  A.-.i.'ity  for  ifkicc  or.d  ’.'.lr.jtion,  ande» 
*.i;e  prr.'Or  jhtr  o'"  the  A.-lsunit  ..ecretiry  ef  refvnce  (Rikl  is  coordl.-.-itlng 
•r'.'rt,-.  1.  ••  t;i'  d'-.-r l.-v-rei.t  of  .'i.il.i  on  snlci;  u.id  vib-nllan  er-cojite.-cd 
...  hr  ;.,'.,,  'T.!  t .- itun.  .-x.rt.'icr  a  r.c.  rec;-.rd''r  cf  sno.'s  .rd 
•.'I'.r-.li.'.n  being  c.ev.i’.o^cd  iinder  the  e;<-.-;s'r.sh;i  of  the  K.iv.-!.’  Re.icjrch 
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Indicated  careful  design  and  testing  of  toted  eguipnent^  prior  to  the 
oubadsjion  o.  shipping  container  deslf^is  'for  new  equipment  for  approval 
by  the  Coverijscnt. 

It  was  the  consenaus  of  tne  Task  Croup  that  with  the  work 
currently. unde rvay,  iaproveacn;  eon  be  cade  to  the  packaging  and  packing 
of  clectironic  equipceat  which  will  improve  rellaHUty-  However,  the 
industry  .-xprcser.tativcs  did  point  out  that  by  close  colluborution  with 
the  container  iesipier,  some  eqaipsicnts  "ere  t  ng  built  more  ruggrd  taan 
in  the  past.  This  .as  particularly  time  of  8h.,«Kwrd  electronic  eqalpceat 
iind  Signal  Corps  field  cosisunicutions  equipment  where  the  e/ivironaent  of 
use  made  laore  ragged  design  a  neceMSlty  for  operational  reasons. 

6.  Ta.4'K  Group  recoonends  that  in  view  of  changing  conditions  and  the 
many  new  tu.i  unique  development  in  thin  rapidly  changing  field,  it  is  cf 
the  I'.tBMst  acpcrtance  that  close  collaboration  be  oaintulned  between  the 
equipment  acsiipie.’*,  the  container  decigner  and  the  Govei-naent. 
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ABSTRACT 


This  repc  rt  presents  the  results  of  the  investi(atu>ns 
conducted  b;  Task  Croup  -  S,  ACRKE,  durui(  l(tS6. 

On  the  basis  of  the  data  analyzed,  there  is  a  90  per  cent 
probability  that  the  expected  failure  rate  due  to  stora^  . 
cf  AriaaCrf  Forces  eiectiontc  equiprnt.nt  is  not  in'eater 
'than  0.  OiO  per  cent  and  not  less  than  0.  C3,<  per  cent,  bi 
other  uords.  the  reliabilite,  at  the  90  per  cent  confi* 
dence  level,  of  these  elerironic  equipt.ients  in  terins 
of  the  effects  on  reliability  of  storage  only,  is  from 
99.  960  per  cent  to  99.  965  per  cent. 

These  results  indicate  that  the  protlem  of  failui'ks  due 
to  storage  is  not  serious  inhen  compared  to  the  problems 
of  failures  due  to  other  c.suscs,  such  as  medequaie  r-uia* 
ponent  and  etpiipinent  design,  txiorly  controlled  msn'j* 
fa>t’:rinp  and  ..ssembly  processes,  contractor  and  oe* 
repi-M>'Ce  iiiapectton  mconsi.Menries  and  invaiid  failure 
reports  resulting  from  inspection  an.-i  testing  errors 
10  siorage  and  in  the  field. 


I,  DiTRSDl'CTtOX 


I  1  Purpo»«  of  the  Prufrus 

The  Fttrpose  cf  S'*  -;ro{r»in  »ss.gr.t4  tc  T»i»  Group*8  bv  AGREE  i»  *’lo  in* 

.kc  iffe.'ts  c «.f  e’.ectror.ic  oor.^seet  upon  reliability  and  r** 
cjesr-.er-d  in;Frc\«=-.er:i  »h<re  de‘‘rabte.  " 

Tke  e:'re*.;»  pa:4a;.r^.  trar.^portatien  arii  birAlItag  are  no«  coniiidercd  aa 

efTo.  :=  rf  storape  *.i  «  rv/ort.  T*.e»e  frobleir.i  uere  invesiiphted  separately  by 
a.-'i.'acr  ACHLE  Task  CrtArp 

1  t  Approach  to  the  ProiU" 

I:  Kas  i^rerd  t.M:  the  results  obtauied  b»  the  u'c-.p  wjulo  depend  on  the  • 
are^-i..'  ar.d  vi'.idttj  rf  the  dau  a'.ailaote  frc-rt  the  vartsus  branches  of  the  Armed 
tcr.e#  a.-.d  front  ire-str;  Os  tkss  basts,  the  Ott-.p  set  up  the  lOllowutK  approach 
•c  tre  p:  Jt.em. 

!  2.  t  To  rcsststr  evotrittent  failure  as  the  steasurc  of  reliability  and  to 
f, '.'flier  cotsponest  jr  pjece-part  failure  only  for  analysis  of  the  causes  of  equip- 
tit  -.t  fa -lure 

:  .•  'i  to  stjd»  those  e'ftiptr.tsts  required  tc  operate  continuously  or  inter-  • 
r-.'*e-'..y  for  ex*e.-  o»'C  pert.ds  v’f  t.tr.c  and  also  -ht-se  equipments  required  to  op- 

e. -a*i-  ,-.ty  cs.'e  fer  a  l.s.ted  p*’‘v.<d  o:  time.  .  •  •  ..u  . 

12  3  To  iT.aestirate  ati  avaiUblc  sources  of  raa. 

.  2  a  To  re>  IT*  a:,i  evabuiie  the- data  o)>:a.re-d  from  these  sources. 

1.2  a  'to  dra»  c-'-u-lust-.-ss  :h  terms  of  the  e'le  ts  of  storage  on  the  rcli- 
of  •'Jectror.K  tqutjtr.esf 

1 .2. €  Tc  repert  the  ih<rstieatiO'.i  results  to  AGHEE 

1. 2.  T  To  rec o—.nterd  cer-ain  actions  by  the  lir tartmeiit  of  Defense. 

T-.e  ^^a;.a^^cr.  r:  ii'i  ar."*  th.-  de;errr.l".a'!.-r  c'  — estimate'  are 
.  -  .e  -  O'  l-rt.  rt’.-'  -...  .'f  rr'iab::.:'  i-v-.  reqiirfmcr.t'.  for  vari- 

•s  ■'  'es  "f  n  il.ttsry  c.c  e-r.:.-:.- e-t-  Ta"  for  the  purpose  cf  Its 

.jS '.cr.  t'tj  a.-. -'-i  "  ■  c.Iovu’g  def.-.i-io-* 

■  1  ■'  fa£i'^  -  T-e  'ai.ure  of  an  equ .f  V  “eet  spe<  ifiert  'iieralional 
-cl.  t;  i.-.res 

.  3  f  '.-ocaM-.t/  tfut-  ar  r.-  •i".  meet  the  .sijeclfied 

.  ti"'  ■  a-.-  re-  •  r  "e  :.t’  iltty  that  .an  equip 

ter'  T  *t'*' a'  — c  ';re  of  r.'.r'j.e  .a., ectio.t  or  uS**  (briefly,  the 

f.  -  mat  ..'  arris  a*;..n  t4r-.ev  ..  * 


^  ^  ^  a  ,  a.  aS  u  a  a*  ua  all  a-*  a  a  wa  U"*  va  WU  ah*  wa  .a  -a  U'»  Uha  Uha 


I  >  liii —'lA  I  il  t  *«*n*  a.'.  h.h 


t.  SUMMARY  OK  THE  PROGRAM 


2.1  SourcM  of  0*U 

CenUcu  wtro  mod*  wt»h  numorout  concerns  'in  th«  fields  ol  devolopmont, 
manufscturc,  and  use  otetactrontc  equipments  throuKhout  the  Unitod  States.  Al¬ 
though  many  groups  arc  planning  future  studies  of  the  effects  of  storage  on  aloe- 
tron’c  equipment  reliability,  none  has  data  available  for  analysis  at  this  tint*. 

In  general,  since  World  War  M.  msr.ufrcturers  have  not  had  eleetronii  equip¬ 
ments  in  storage  for  eatended  periods  of  time,  because  the  demand  has  exceeded 
the  supply  in  most  cases.  Therefore,  the  study  by  Task  Croup-t  is  restricted 
to  data  from  the  following  sources. 

2.1.1  Army  Signal  Corps  Oep^la 

2.1.2  Army  Signal  Corps  .Engineering  Laboratories 

2.-t.3  Army  Sijpial  Equipment  Support  Agency 

2.1.4  Navy  -  Bureau  Ordnance 

2.1.5  Navy  -  Bureau  of  Shipa  * 

2.1.$  Air  Foret  -  Air  Material  Command 

2.1.7  Waatern  CMsTric  Company  "  Field  Cn^inaaring 

2.1.8  Sandia  Corporation  •  Quality  Aasurance 

» 

2.2,  Analytes  of  Data 

The  reports-  submitted' from  the  various  suuroos  were  not  esprqsr«4  in 
compatible  terms  end  could  not  be  converted  Into  valid  statements  of  comparative 
failure  rates  or  reliabtlity  with  any  degree  of  consistency.  For  this  reason  in¬ 
formation  has  been  converted  into  estimates  of  maximum  oxpseted  failure  ratee 
due  10  storage  by  tempering  suttstjcs  with  experience  iind  engineering  judgment. 

2.2.1  Data  from  Signal  Corps  Oepo*B 

2  2. 1.  i  The  Signal  Corps  employs  a  so-called  recertifkatlon  pro¬ 
gram.  Dumestic'parked  equipment  is  unpacked  A.iJ  traied  at  three-year  intervals; 
evpoft-p.-ri'ed  e';i'.^.nent.  at  f»ve-)ear  mtervs’.s.  No  reward  is  kept  of  the  test  re¬ 
sults,  or  evrn  of  .h « r.-imbcr  of  equipments  accepted  or  rejected.  Since  the  Signal 
Corps  data  are  in  terms  of  tons  of  electronic  equipment  examined  durmg  surveil¬ 
lance  programs,  the  per  rent  sampled  and  the  per  cent  defective  reported  can  givo 
only  a  general  indication  of  the  effect  of  storage  on  rclUbillty. 

It  is  estimated  that  over  fifty  per  .  ent  of  the  equipments 
Imolved  in  this  study  had  beer,  in  storage  for  a  period  of  'rom  three  to  five  years 
St  the  tune  of  suryeiilanre  inspection. 

The  reports  submlled  included  qu-'ntities  tested,  quantities 
rejerted,  and  «.->timates  of  the  percentage  of  rejections  cs  ised  by.  or  as  s  result 
of.  storage. 


Obvloutly-.  unl«M  M  •ii(iaMrtoc  iMtfy  of  cauMs  o(  r«> 
jMtion  is  msds,  the  aclusl  tstlurs  rale  is  slersfe  csnnot  be  stated  and  subsequently 
anaiyied  to  detuemin.’  which  fs<iur«4  artuaUy  were  due  to  stpraife  conditiont  and  not 
to  other  (.auaca.  The  data  are  not  such  that  as  ei^inaerlfly  study  would  be  practical 
at  this  Uma.  • 

2. 2.  t .  3  The  Sifnat  Corps  depots  reported  on  a  total  of  6. 7(1  tons  of 
stored  electronic  equipment  that  were  inspected  duriny  the  surveUlanca  programs 
at  the  four  reporting  depots.  Th.-  .nspcctlons  were  performed  during  various  per* . 
icds  between  1  July  1364’and  t  June  I9&(.  (See  individuat  depot  reports  in  Ap> 
pc.iduA.) 

2. 2. 1 . 3  The  .figures  in  tons  of  equipments  have  been  converted  to 
numbers  of  equipments  after  a  atudy  of  the  variation  in  equipment  type,  weight, 
and  complexity  at  each  storage  location.  Thia  conversion  procedure  wes  arbl* 
trary  and  based  on  estimates  made  after  d»cussioiis  with  Army  Signal  Corps  per¬ 
sonnel,  not  on  actual  report  flgurea. 

3. 2. 1.4  The  total  Sigt,el  Corpa  Surveillance  inapeetiona  reported, 
represent  examination  of  approximately  37S,S(S  equipments,  of  which  7, 344 
(1. 95  per  cent)  were  relucted  for  defectiveness  described  as  'dsterioration  in 
storage. '  Obviously,  something  less  then  this  1.05  per  cant  of  tlie  total  sample 
inspected  can  he  considered  as  representing  rejections  for  actual  fellurea  to  fune* 
lion. 

The  n-,eintenanee  of  compleir  records  of  failunts  a.nd  failure 
causes  would  provide  s  more  valid  basis  for  evaluation  and  determination  of  tlie 
actual  effects  of  storage  on  the  reliability  of  these  equipments. 

2 . 2. 1 . 5  Asa  result  of  comparison  with  other  source  date,  it  U  .lie* 
Ueved  that  the  average  actusl  failure  rate  of  Signal  Corps  equipments  due  to'stor* 
age  is  approaimately  0. 1  per  cent;  and,  on  ih*s  basis,  therp  would  be  s  90  per 
cent  for  I).  9)'probi.biiity  ti»t  the  expected  failure  rate  due  to  storage  would  not 
exceed  0.  lOS  per  cent. 

2.2.2  Data  from  SJgnai'Corps  I’nsalisfartory  Equipment  Reports  (UCR's) 

2. 2. 2. 1  Kor  the  period  1  July  1955  through  3i  Dc^vr'her  1955,  ex¬ 
amination  of  730  Ub'K's  disclosed  that  failures  due  to  storage  were  not  reported 
as  such  hut  were  Included  in  the  cutegory  of  miscellaneous  Ksiiurcs,  which  cov¬ 
ered  92  reports,  or  14  per  cent  of  the  defective  equipment. 

2.  2. 2. 2  Of  408  Unsati'sfavtory  Equipment  Reports  processed  in  the  . 
quarter  ending  di  .March  1956,  nine,  or  2.2  per  'cnt,  identilied  storage  as  the 
cause  of  failure.  Investigation  of  these  nine  revealed  the  following; 

a.  Three  reports  covered  transformers  made  by  the  same 
firm:  one  covered  a  mebtllic  rectifier  used  m  the  sanic  piece  of  equipment,  'this 
equipment  had  been  in  storege  (type  of  storage  unknown)  in  Okinawa  for  seven 
months.  Ils  previous  storage  history  is  unknown. . 

b.  Three  reports  covered  dry  batteries.  One  group  of 
the.se  batteries  was  obviously  over-age:  the  age  of  the  other  two  groups  was  not 
stated,  but,  there  is  reason  to  believe  these  groups  also  were  over-age. 

c.  One  was  rul/bcr-covered  multi lonductor  cable  stored 

in  Germany  for  an  unknown  pi'riod  IndKations  are  that  it  probably  had  been  there 
for  over  l-n  years. 

d.  One  was  an  un-reftnished  metal  cabinet  showing  definite 
si^s  of  previous  u.se  and  abuse. 


*9 


The  meteUir  .rectifier  ef  ’‘e"  above  and  the  batieriea  of  “b** 
are  kaewn  short  shelf*tife  items;  tfie  table  of  "c  '  was  obviously  over*ace  and  the 
cabinet  of  'd'*  was  clearly  the  result  of  use  and  abuse,  not  storage.  This  teavea 
only  three  of  the  origiral  nine  re|>ons  which  may  be  blamed  on  storage,  thrugh* 
there  is  no  actual  proof  thar  stnrage  was  respcnsible:  the  three  transformere  of 
"a”  m^have  been  from  a  defeclite  lot. 

This  reveals  that  of  the  40t  Unsatisfacto  y  Equipment  Re*, 
ports  analysed,  a  maximum  of  O.  Hb  per  cent  of  the  failure:  'Ciiorted  may  be 
blamed  os  storage. 

Since  no  sample  site  can  be  determined,  no  estimetf  of 
failure  rate  can  be  made. 

.  2.2.3  Data  from  Navy  •  Sureau  of  Ordnance 

Records  on  cyclic  inspections  of  .Fire  Control  Instruments  over  a 
period  of  five  years  (equipment  in  T;pe  One  controlled  storsgo.  30  per  cent  R8 
end  Vfiff  for  three  :o  five  years)  sh^-thst  of  3. 54S  equipments  operated,  no 
failurea  due  tn  storage  were  reported.  Operational  faUurea  were  attributed  to  ' 
ottitr 

On  the  basis  of  these  data,  there  is  a  90  per  cent  (or  0. 9|  probability 
that  the  expected  failure  rate  (Hue  to  storage)  under  these  storage  eorditiOita  will 
n«  be  greater  than  0. 06S  per  cent.  (For  details  of  Navy- -Bureau  of  Ordnanco  ■ 

'  Cyclic  Inspection  «;  Tire  Control  instruments  see  Appe^tx  U. ) 

2.2.4  Data  from  Navy  -  Bureau. of  Ships  ■  ,  .  ' 

2. 2. 4. 1  A  study  of  22. 000  equipment  failures  showed  Diet  52.  or 
0.24  percent',  were  attributed  to  storage.  A. total  of  60  component  failures  on 
these  equipments  were  reported.  Of  these,  i?  were  electron  tube  failures,  3d  * 
sere  ca|iacttor  failurea,  and  13  were  Itsted  as  miscellaneous  failures. 

'  2. 2.  V.  2  Another  study  ef  33, 000  equipment  failures  showed  that 
four,  or  0.012  per  cent,  were  attributed  to  storage.  These  equipments  hsd  a 
tctsl  of  ss  fstnixinent  failurea.  of  which  four  sere  electron  tube  failurea,  one  • 
resistor  failure,  and  one  a  filter  failure.  ,  ■  ,  '  .  • 

2.2.4. 3.  An  engineering  iiivestigation  of  the  above  eomiwnent  failures 
would  be  necessary  to  determine,  if  they  were  actually  caused  by  storage  eonditisns, 
ir.erefore  the  range  (0. 1)12  per  rent  to  0  24  per  cent)  of  the  per  cent  of  failures 
attributed  to  storage  cannot  be  used  as  a  valid  dSnim  for  drawing  conclusions. 

Smee  the  numtwr  of  equipments  operating  satisfactorily  during  the  ,'eriod  of  test* 
ir.g  IS  unluioen,  no  statistical  retiabihty  estimates  car.  be  made.  (See  Ap)>endix  C  . 
for  Navy  -  Bureau  of  Ships  data  summary.  X 

2.  2.  4.  4  An  investigation  into  the  "liracttve  Fieri  Records"  disetosed 
tiia:  no  valid  data  ar';  available  concerning  the  operability  of  clcetrontc  equipment 
a;  the  time  o(  inactivation  or  at  the  time  of  reactitaticn.  Complete  and  accurate 
records  of  this  operation  would  have  been  of  great  vaitie  in  the  study  Of  the  effeett 
of  s'r.rage  on  t.he  rci  lability  of  electronic  equipmert. 

2.2.5  Data  from  Air  Force  -  Air  Materiel  Command 

2.2,5  1  Analysis  of  100, 400  I'i.AF  fatlu'c  reports,  covering  both 
all  -.Ajrne  and  ground  electronic  equipment,  revealed  that  454.  or  0,  45  per  cent 
of  the  .a:  fj.iufp.s  were  attritiuted  to  .storage.  These  data  were  published  in  AMC 
»-.on-r7<)-nB  (70  Jul;  lvS6).  pp  u-.t  r.o  s.t'v.  ir.ation  on  the  number  of 

r..,.faT.e.*!s  r.ct  falling  •l.-c  na  •!.*  pcriOu  >uvcreo  cj  the  report  is  avaiiabiv. 

Ker,.  c,  r.u  failure  rate  due  to  storage  ts  kraiwn 


2.>.  S.2  For  slatistiesl  purpose*,  hemtntr.  tbe  Croup  msd*  an 
arbitrary  assumption  ot  an  uver-slt  failure  rate  of  five  per  rent.  This  is  an  *stl> 
mate  oased  on  discussions  with  Air  Font  personnel  £*cn  when  this  h.(h  over* 
all  (allure  rate  is  assumed,  the  failure  rate  due  to  storage  is  only  0. 022S  per 
ernt  and  there  Is  a  90  per  cent  (or  0.  9)  probability  that  the  capected  failure  rate 
due  .o  storage  will  not  be  greater  than  0. 324  per  cent.  tSee  Appendix  D  for 
source  of  above  data. ) 

2.2.6  Data  from  Western  Electric  Company  Field  Engineering 

2.2.6. 1  A  total  of  46, 000  Field  Engineering  Air  Force  Equipment 
Failure  Reports  were  analysed.  Of  these  failures.  2S4,  or  O.S  per  cent,  were 
attributed  to  storagn.  However,  many  c-f  these  equipinai.t  failures  were  'tai  re¬ 
sult  of  electron  tube  and  other  cotroonem  failures  tint  may  have  been  due  to  de* 
sign  or  manufacturing  causes,  so  the  actual  failure  rate  of  equipments  due  to 
storage  was  pr''bttbty  much  lower.  Since  no  record  is  available  of  the  number  of 
units  operatmg  satisfactorily  daring  the  test  period  in  which  the  above  failures 
oevurred,  no  sutistical  reliability  estimates  are  pcssfblo. 

2. 2. 6. 2  Storage  of  the  above  equipments  was  hi  warehouses  within 
the  United  States,  and  since  the  maximum  period  orstorage  was  estimated  to  be 
ninety  days,  ft  is'  not  likely  that  storage  conditions  would  hsve  had  time  to  affect  ' 
the  (Unction  of  a  significant  number  ot  equipments.  (See  Appendix  E  fur  support'* 
ing  information. ) 

2.2.7  Data  froiu  Sandia  Corporation  Quality  Assurance 

2. 2.7.1  An  analysis  of  storage  inspccliOBs  reported  by  the  Armed 
Forces  in  two  general  storage  areas  (A  and  B)  or.  Sandia  Corporation  designed 
electronic  equipments  dm  "'ft*  .'our*year  period  (1  January  1962  through  31 
December  1 966)  results  .  s  estimated  failure  rales  sbowa  on  the  chart'  on  p  1 F.. 
These  Sandie  Corporation  dau  indicate  an  average  of  a  little  ever  u«e  feilure  re- 
ported  as  due  to  storage  per  thousand  equipments  in  storage  Juruig  the  steted 
four*year  period:  and  a  90  per  cent  (Or  0. 9)  probability  that  the  expected  failure 
rate  due  to  storage  would  not  be  greater  ihM  0. 136  per  cent.  However.-  the  anel« 
ysis  indicates  that  n.any  of  these  failures  sp;  -.ently  were  >lue  to  inherent  equip* 
ment  or  compuneid  w<.iknesses  that  can  be  traced  to  deaipi  or  manufacturing 
causes.  (.See  Appendix  F  for  supporting  information. ) 

2. 2. 7. 2  An  analysis  was  made  of  34. 562  storage  Inspection  reports 
received  from  the  Armed  Forces  covering  inspections  of  5,246  units  of  Sandia'- 
Corporation  designed  electronic  equipments  durbig  the  lalarwat  1951  through  1954. 
The  data  were  processed  for: 

a.  Tims  in  storage  before  failure. 

b.  Correlation  between  time  in  storage  aqd  number  and 
types  of  failure, ' 

c.  Number  of  inspections  before  failcrt.’ 

d  Correlation  between  number  of  Inspertions  and  types 
of  failure 

Items  s.  and  b  are  shown  an  CHART  A. 

Items  c  and  d.  are  shown  on  CHART  B 

2. 2.  7. 3  The  only  electronic  equipment  failures  in  storage,  as 
shown  on  CHARTS  A  anJ  FJ.  that  could  joissiiW  be  attributed  To  storage  are  i.hoie 
indicated  iS  due  io  unknown  causes.  U  *.b:.‘.  a-suirpt:or,  made,  the  faik  'e  rate 
due  to  storage  was  0  Ij  per  cent,  and  ir.ere  is  a  9C  per  ler.t  (or  <J  5)  probability 
that  the  expci  ted  fai’-.ro  -ate  due  to  storage  is  not  grea’er  than  0  135  per  cent. 
(Sse  Appendu  F  tor  supporting  iptorma'io-,  ) 


Forc«»  is  not  grestor  than  0.  MO  ptr  'cat  and  not  less  than  0. 035  pee  e«^  In  ' 
other  norcis,  the  reltanilitv,  at  the  90  per  rent  confidence  level,  of  electreirtr 
equipments  in  terms  of  the  effects  on  reltsbihl/  of  storage  only,  is  from  M.tM 
per  rent  to  99.  v65  per  cent. 

3.3.2  In  many  cases,  failure  rate  figures  were  not  avaiiahte,  and  the  dtf> 
ference  betueen  failure  rate  and  the  per  cent  of  failures  that  are  due  la  storage- 
must  be  kept  in  if  md  at  all  tunes.  Tticse  are  defined  an  foUoera: 

a.  Failure  rate.fin  per  cent/ 

fft  inn  «  Total  failu;-es  due  to  storage _ 

due  to  s  ge  100  *  equipn-erts  inspected  in  storage 

b.  Per  cent  of  failures  due  to 

_ -  Tjtal  faihires  due  to  storege 

.  *  Total  faUurca^mJU  causes 


S.hNOU  COr.PORATIOSf'DESIGKED  ELECTRONIC  ii:!QUa»)tElftS 
FAILVRE  RATES  VS  INSPECTION  FREQUENCY 
(Based  on  Storage  Inapcctiooo  by  Armed  Porcea| 


2  3  45  $  7  S  giJil  over- 

Sf.MBER  OF  KSPECTtWS  ■»* 

— ,  total 

I  Itu-to  Failures  Tunings 


jResitiora-,  Capacitors,  etc. 


Mechanical 


{Crvatala.  Mixers 


Unhnowa 


CHART  B 


J.  COXCU'SJCJNS 


3  t  Tne  rekults  o(  mvestlfatfaMS  by  Ta^i.  uulicate  that  th*  problam 

of  failures  due  to  slora^  is  not  serious  »hen  coezfAr*^  to  the  problems  of-failorea 
due  to  other  causes,  such  as  insdt'ituate  compooes'  and  e<}u>pment  design,  peorljt 
ccniroiied  manufacturing  and  assembly  pro^sses.  contractor  and  acceptance  ta- 
spe.tioR  inconsistencies,  and  invalid  failure  reports  reaulitng  from  lospecttod  and 
testing  errors  In  storage  and  in  the  field. 

3  2  The  life  histories  of  individua.  amts  of  etectrocK  egutpmenU  teve  not.  iii 
general,  been  recorded,  so  that. the  condition  or  cperabihty  of  the  ct{tttpmeol  at 
the  time  it  is  put  in  storage  is  uausUy  unknOan.  Laser  evatuaiioos  cannot  then  be 
correlated  with  previous  data.  In  other  words,  the  more  that  la  known  about  any 
e(]ui<  thent  when  it  is  put  in  storage,  the  mov*  can  b*  teactied  about  the  effect  of 
storuge  on  its  reliability. 

3.3  The  Group  found  tlut  ihere  are  conaiderxble  data  in  the  files  of  the  Armed 
Services,  thiti  can  be  usefut  to  the  AGREE  pregram  ir  genei^ 

4  It  is  believed  that  competen.  engineering  and  statistical  asaiatanc*  is  needed 
in  the  programming  for  machine  analysis  of  these  iti*.  which,  lor  the  moat  pert, 
are  on  EA.M  cards  or  magnetic  tape.  CoasKcran.e  information  ta  available,  but 
it  niust  he  converted  to  a  standard  form  that  >cds  itself  to  statistical  and  >.ngi* 
ncering  analyses  and  the  subsei|uenl  reporting  of  nesidu. 

3.  i  The  cost  of  gathering  and  recording  thu  a^asa  of  data  should  not  be  wasted 
by  allowing  the  in'ormatlon  to  remain  in  an  arc.hwed  state,  of  use  far  his'hrical 
purposes  only.  Through  a  program  of  planned  refscMn  and  aoalysis,  with  per* 
iodic  publication  of  rcaulta  as  a  means  to  dectsiar.  makieg.  tlie  cost  already  io> 
curred  ran,  in  some  measure,  be  justified. 

3. 6  The  Inspection  and  mainienince  operaiuea  in  the  fwld  do  i.esur*  that  the 

operability  of  equipment  is  nmintained  out  vniess  the  re* 

cords  of  these  operations  are  valid  in  ronlent.  are  teperted  pror.  ptly  and  too- 
aisteiitl),  and  are  used  as  a  basis  far  correctre  actica  «l  thr  design  and  rnanu* 
facturing  stages,  (hey  have  only  partully  fulfilled  their  purpose 

3.7  On  the  basis  o*  R  portion  of  the  data  casmmed  it -.s  prot%able  that  the  varia¬ 

tion  in  accuracy  and  preci.stun  of  the  test  e'quirr.er..  v^ed  u;  the  field  an.  in  storage 
tests  IS  such  that  a  considerable  percenlaf^  i*:-  leas*  Z'  (*r  ceml  of  ihe  rc;er^ion 
and  acceptance  dec  isions  made  are  inialid.  These  e.  rf.teeus  decisicni  may  to  - 
some  extent  balarce  out,  with  the  errors  or  -rjcticr  heing'Offset  staiisUrally  by 
the  errors  of  acceptance,  but  t(  is  unsound  to  draw  def.tite  conclusions  'rom'sueb 
an  assumption.  I>  can  be  staled  with  assur  her.  hocivr.  (hat  (hr  errors  occur 
of.en  enough  to  cast  doubt  on  the  results  of  tne  tests  made  on  rlcrtrcnic 

equipments  in  storage  and  in  Ihe  fntld. 

This  conclusion  is  supported  by  Ihe  rejort  of  "ash  Subcommittee  B*Z  a  the  ' 
Tube  Application  I'lanniiig  Group  i;A(R)  I  of  K£T M.-. -.iU.iw'-EIertror.'.ts-Te’evisiiio 
Manufacturers  Assoriatio:t]  published  2  October  ;?f#  present  ssraa:>>u  is 

;vm!rJ  ou(  in  this  report  and  a  recommenclacoc.  is  n-.afe  for  the  design  of  stntpli*  ' 
fatd  sunjard  te'.l  equtp.nent  that  <  an  be  (a)  calibrase.'  the  field  using  tvadible 
baste  slanctardh,  nnd  (h)  mairiiaiitc-d  hi  a  state  rf  a;c-.-xr»  that  will  iTiinitnite  re¬ 
jection  and  .hicopUnce  errors  resulling  from  in..  Jc-qtately  roniroUed  and  maji- 
laincd  test  equipment. 

The  Group  ha«  com  luded  liial.  (•  ■  .  t*w  c--*-c-  f  » tequatc  test  equipment 
ha'  been  treated  as  a  secondary  requ  i  .  . — see  ct'-.-f  ■hat  i>  rnn.»idcred  after,, 

rot  duri:  g,  th.,  la-riod  of  design  and  man-i-.  'vir  ct  tre  elcc'tromc  equipments 


Ob*.oMMy,  <hl«  to  toiUrieus  pUmuif  jnd  viMethioa  which  MBUItt  te  . 
the  delivery  of  oquifs'.onis  that  cannot  bo  adr^atelf  tested  for  roltohility  nf  hmetiM 
ant:' some  latcfperhaps  too  iate>-(tate  preacnl,  much  of  the  tost  o^ulimoaf 
ji  uae  ts  teas  ;‘«luble  tMo  the  ei]utpmcnt  test^t.  thus,  the  results  of  the  testing 
rf  hsrile  Vt  «at«i  for  anaijrsts  1ft  terms  of  the  reltoblllty  of  the  eqei^ 

cents. 

i.  t  The  Group  believes  that  tiierc  to  *  baste  lack  of  managemenl  underslaitdiiig 
of  t.he  nted  for  the  valid  and  specific  data  that  are  re:;uired  for  reltobilily  aludiea 
aad  estimates.  To  date,  most  dtsrusttons  at  the  management  level  have  bcea  , 
gtairzl  and  ^iiosophic.  showing  a  lack  of  the  iradershtp  necessary  to  direct  tl;e 
Ixe  orcanizationr  toward  a  program  of  improving  the  qualtfications  of  inspection 
and  eval-iation  personnel  and  equipping  them  with  mote  adequate  testers  and  test* 
mg  and  reporting  procedures. 


4.  URCOMMENDATIONS 


'task  Group-t  presents  the  following  recommendations: 

4. 1  That  the  apparently  widespread  philosophy  that  adequate  and  valid  testing 
a.nd  reporting  are  not  military  hinctions  of  primary  importance,  even  ouring 
peacetime,  be  reviewed.  If  ts  believed  that  alt  levels  should  be  indoctrinate 
«:t'i  the  philosophy  that  when  an  emergency  arises,  previous  evalualions  of  dale 
from  inspections  and  tests  will  result  in  the  reduction  of  (he  probability  of  failurw 
of  a  mission. 

4  Z  That  test  and  inspection  requirements  be  reviewed  and  amended  to  provide 
du  cati  necessary  for  rettobiliQ:  studies. 

.4. 3  That  reporting  procedures  be  revised  to  supply  this  data  in  a  form  for  cat* 
sistent  reduetten  and  analysis. 

4.4  Tnat  the  IMpartment  of  Defense  investigate  the  .advisability  of  implemeniing 
t-h*  Proposed  Programs  for  Obtaining  Dau  on  the  Reliability  of  Ete'-tronie  Equip* 
mcitt.  as  outlined  in  Appendto  1.  .  ‘  ' 

4  5  That  sufficient  authority  be  vested  in  quality  control  organisations’ in  all 
branches  o(  the  servK-e  and  in  industry  to  assure  their  fuirillmi.-nt  of  the  responsi- 
a:.:tx>s  outlined  10  4. 3  anf  4.3  above. 

4. 4  That  a  planned  prograui  of  reducing  and  analysing  the  itotc  now  on  file  be  pit 
mic’effect  at  an  early  date  m  order  to  capitalize  on  the  available  information  to  llie 
cate.'.!  that  sources  of  deferiiveitess  may  be  discovered  and  correelivs  setion  taken. 

4  T  That  3  centralised  working  group  wilhm  the  Or^rtment  of  Defense  be  estab- 
'  listed,  on  a-cor.'.:r.uirg  basts,  to  coordinate  and  evaluate  the  reliability  data  from 
aU  sources  arc]  to  repor'  the  results  of  these  evaluations  at  regular  intervals  ao 
Ua;  prctr.pi  action  can.be  taken  vh.'n  necessary.  ■  . 

4  e  That,  if  the  results  obtained  by  the  other  eight  AGRUE  Task  Croups  confiriM 
ibr  -levi  for  more  rcilabie  daU  in  order  to  delermir.e  the  actual  reliability  of  the 
var-,<x$  electrc.-.ic  equipments  and  to  isolate  the  factors  that. contribute  to  unrelt- 
ar-;:y,  .AGRFE  consider  »  conirolted  experiment  mvoMng  the  storage  and  test- 
ir;  if  a  siaiistically  significant  sample  of  typical  eicctrnnic  equipments.  This 
rt  wovld  be  piaruied  and  executed  under  the  supervision  of  trained  engl* 

nee.-s  and  siatisticuns  and  would  be  rondarted  independently  of  other  storap:  and 
teste.g  prelects  Valid  data  on  the  effects  of  siorage  on  reliability  that  might  con¬ 
fers.  or  modify  the  conclusions  drawn  by  the  Group  ui  this  report  could  be  (Stained 
ccor.rrertly  from  SM-h  a  program. 


NOTE: 


».i.™u«  „  „,  e»„,. .,  mU'SivS'S 

iv  te  ZSZ,  i’To'K^  “Jr.'""’ ""’  "»  '“V 

l*in  of  obuininf  hi^iir  rvliobUitv  ofVwV  ***  *"'*'"*“  P«** 

ctwi»ed  by  th*  ArwJd  '  of*tecfronic  •quipmeot  pur- 


AiVENDlX  A 

..  1  SIGNAL  CORPS  Sit  PPOHTlNC  WPORUATION 


Follow  Ifij  or*  copies  of  the  correspondence  thet  wet  used  ••  •  benis  for  the 
analysis  of  Siipul  Corps  failures  due  to  stcrafe  In  •d^’ilion,  discusaiona  were 
held  with  Signal  Corps  personnel  to  clarify  and  augment  this  informatiell. 

This  appendut  also  includes  proposed  programs  for  obtaining  data  on  the 
effect  of  storage  on  the  relubility  of  electronic  eipiipmcnt. 


HeADQUARTERS 

SIGNAL  CORPS  ENCIN'EERIN'C  LARORATORICS 
For!  Monmouth.  New  Jeraejr 

SICEL'Pmm  'i  Cowdiandinf  Ue^r*al, 

<  .  f  “ 

3  APR  itM 


SUP  1  "CT-  Reliability  of  Electronic  Equipoteni 

TO:  Cuiiiiiiaiitliiig  Genoral 

Sigr.al  Corps  Supply  Agency 
22S  South  Eighleanlh  Street 
Philadelphia  J.  Pennsylvania  '  ' 

ATTN:  SIGSU'HS 

t.  The  Office-of  the  Assistant  Secretary  of  Defense  haa  reqeealed.  thrdugh 
the  Advisory  Group  of  Relubility  of  Electronic  Eijuipomnl  that  these  Laboratorcea 
supply  the  inforrtstion  outlined  below: 

a.  Are  equipments  (not  piece  parta)  tested  pericdtcally?  If  aot  how 
often?  if  £0,  are  they  required  to  meet  the  rchuirementa  rf  the  appUceble  Signal 
Corps  Repair  Standard  at  each  testing? 

b.  Are  they  tested  before  shipment?  If  so.  are  they  tested, only  at  tho 
time  oi  repair,  if  repaired,  and  before  shipment? 

c.  if  either  a.  or  b  aoove  are  standard  practice,  doc-s  3rour  office  have 
records  of  test  results  on  individual  equipments,  obtained  at  different  limest 

d  if  the  records  menlfmed  in  c  sbove  are  riot  available,  do  yen  have 
test  results  obiaiiutd  at  lime  of  repeir,  and  lest  results  on  other  similar  equip* 
ments  obtained  after  a  period  of  storage? 

e.  Any  other  infonnation  available  on  the  effect  of  vtorage  on  electronic 
equipment. 

2.  if  any  of  the  above  mentioned  data  Is  available,  will  sui^lylng  It  be  • 
minor  or  a  major  problem?  If  major,  to  what  catent  and  at  what  estimate  cost? 

3.  The  purpose  of  the  above  oue.'tlons  is  to  atteirpt  tn  dePirmine  *he  extent 
to  wbi"h  .Isr'.caic  equipment  deter loratea  during  sloruge,  and  to  attempt  to  de- 
viii  a  rrrthcd.  or  methods,  to  co.-nbat  auih  deterioration. 


Afpii  J-  u  1?^  **•  by  (hU  cTfie*  not  Uior  dtan  U 

.£11**  ****  f*  **.*“*  diPffted  that  this  and  othar  inrormalion  ba  nivan  tlw 
abota  manilooad  groap  at  a  coRfarenra  to  ba  naU  17  April  itSt. 

•»  .««,£■  J*  **  *’*®  *bat  Mr.  Harris  of  thaaa  Uboraterias  Fairnlnaa 

.hu“^!ra«  *““*'*^  ‘’J*  “  ^“^•bT  daulU  ralatl^  to 


FOR  TH*:  COMMANDER; 


/a/  Hobart  B.  Tomllnaon 
ROBERTS.  TOMLINSON 
Colonal,  Sifoal  Corpa 
Chiaf.  Pree-Malnt  Cafioaarinf  Ofv 
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S1GSU-H3b  (3  Apr  Sat  B««c«itr/MAB/*3I 

SVBJECT:  Reli»b«iJy  «f  EJbctronlc  Equlpmtitt 

The  A.myS!*n«»  Supply  A^nry.  2«  S.  t8»hS«..  Phil*.  3.  IM..  llAprUSt. 

D»*.  S1CEt.-?MM*3 

u  furnUhT^f  >  of  be»le  letter,  th,  foBo^ta,  toformfte. 

thereafter*;  •*“  ««  >*«f» 

rcquir**d  every  ihre#  yeArs  uh#n  the  method  utw J.  Inspection  In  . 

year*  when  -sl^rt  ZekT  Tf^  ^  domestic  pecked  end  every  Men  ' 

or  five-year  Umit*(or"verHfic«LM*dal4.^U*^  fojthfpment,  eecepf  wina  the  three 
at  the  Uepof.  J„  m*;*  ewes  exeeeded  due  to  the  aorblMtf 

etp-tpoient.  a.  te.ted  . 

however,  test  dai^j^Ae»»*aM  h****  faautu  he  recorded  at  the-de^a; 

them.  *"«  “’‘^‘"*<1  by  »ome  depot*  and  are  avaUable  fr^ 

as  monttoned  in  para  graph**  tc*above'.'**'**  ***  '*****  ******  **.’*‘*  “P*^  »he  depot, 
i>os,ible.  '■  ‘  *'  *^’*°*  >n»«ructJon»  will  1-,  forwarded  e»  M(.e  •• 

•Agency  and  of  Mr^ Drayton  of  thia 

deppts  will  be  retjuestrd  dirtily  HLL-r  t  ^formation  available  at  the  ■ 

this  study  he  coordinated  with  thIa  agency.  '  ”*  the  reauita  of 

i  OR  THE  COMIHANDEH: 


/»/  Douglas  O.  Toft 
DOUGLAS  O.  TOFT 
Colonel,  Signal  Corps* 
Deputy  for  (duality  Assurance 


OEHAHTMCNT  OP  THC  ARMY 
OKFICE  OF  THE  CHIEF  SICN/.L.  OFFKER 
Washtnftaii  25,  O.  C. 


S1QP0-5A  •  ■  2S»faiy}95« 


SUBJECT;  Effects  of  Storage  on  Reliability  of  Etectronir  E(|uipinent  . 

TO;  ^  >\U  Sig  Corps  Brandi  Depots  .  .  , 

1.  DOD  Task  Croup  on  effects  of  storage  on  MliabRity  of  et^ronies.eipiip* 
ment  has  not  been  -able  to  find  actual  records  froni'any  sereice  to  assist  them  in 
their  endeavor. 

2.  It  is  now  contemplated  to  design  a  reporting  system  to  gather  tnfortiution 
on  a  continuing  basis  which  would  reflect  effects  of  atorage  on  such  e^uiitinMU 

'  S.  The  cost  of  gathering  such  information  will  have'  to  lie  weighed  against 
the  end  result,  l.e.  are  effects  of  .storage  so  insignificant  that  the  cost  wouW  not 
be  justified.  ■  . 

4.  In  order  to  evaluate  this  proiildm.  it  is  requested  that  the  followiag  te> 
formation  be  furnished  for  period  Fy>55  and  9  month  FY>5*: 

s.  Total  tons  proceased  thru  surveiltsnca  program. 

b.  Estimated  quantity  sample  tested.  ‘ 

c.  %  ef  b  rejected,  '  ^  " 

d.  %  of  c  caused  by  or  as  s  result  of  storage. 

A.  It  is  realised  that  aome  of  the  above  information  is  not  svst'sbie.  How' 
ever,  your  best  estimate  of  the  situation  is  requested. 

8,  Request  information  be  furnished  by  15  June  1956  in  order  to  be  avail* 
able  to  Task  Uroup  before  neat  meeting  on  18  Juno  1956, 

FOR  T:1E  chief  signal  OFFICER; 


/s/  U.  Riaque 
FRANK  H.  DRAKE 
Colonel,  Signal  Corps 
Chief,  Distnbut'on  Branch 

B.  RISQUE 

t.f.  Colonel.  S;^al  Corps 
Cinaf.  liepot  ManagenenI  Section 
Oistrihutton  Branch 


Th«  {otlowlnr  r*port»  rtcaived  from  the  Signal  OtpeU  iad'eatod: 

StCrT*!  (2>  May  51)  let  tnd. 

SVfUCCT:  Cffoct*  otStoraga  «a  Ralubilily  of  CUctronic  BagiipiiMM 

Sacramanio  Signal  Dapot,  Sacramanto  1,  California,  11  Juna  ISSf 

TO:  Chiaf,  Proeuramant  and  Distribution  Division,  Signal  Corps, 

Ma«Navy  Baildittg.  Washington  25.' D.C. ,  ATTEKTIOK:  SlCPO-fA. 


1.  Tilts  dapot  has  tnaintainad  aceurata  racords  of  its  surveiUanca  prograa , 
as  of  i  August  tSSS.  Thasa  racords  wars  initially  maintainad  in  tartns  of  loca* 
tions  surveyed  rather  than  in  ’arms  of  tons  processed.  Records  of  tons  proeassad 
are  available  only  from  Novetniar  1SS5.'  ■  '  ' 

2.  Thera  is  on  Hand  approsunataly  2t,  600  tons  of  stored  mstariat  la 
147,  OOO  locations.  During  the  period  1  Novcm*^r  to  30  March,  a  total  of  3.  OSS 
tons  was  surveyed,  or  of  the  total  tons  on  band,  however,  ialhis  Ssata  par*  ) 
iod,  23,  S69. locations  ware  surveyed  or  IS.  7%  of  esuting  loeatians.  This  co^i* 
tion  existed  because  of  the  heavy  amphaais  placed  .on  the  surveiUanca  of  Ibosa 
trsua  items  rattier  than  bulk  stock  items,  eonsequactly  the  ’ocatioo/iona  ratio 
appears  abnormally  high. 

3.  Since  basic  letter  requests  Information  to  be  furnished  in  trrms  of  tons 
prucessvd.  Uw  vuiivei  aiun  from  locations  surveyed  to  tons  preeasaad,  based  on 
records  svailabla.  la  as  foUows: 

a.  T'stal  tons  processed  through  surveillance  program  period  1  August' 

1&S6  to  30  March  19S6,  4, 700  tons.  .  ’  .  ^ 

b.  AlMocatione  containing  aufficiant  qua.ntitiea  to  warrant  sampling, 

were  inspected  by  sampiteg  procedures.  Approxunstely  63%  of  all  items  sur*  - 
veyed  were  sample  inspected.  “  ' 

c.  22%  required  packing,  iabKling.  and/br  repackaging.  ’  3.’ 1%  required' 

minor  repair  or  salvage  disposal  action.  11%  required  segregation  of  mixed  atoek' 
or  retdcntiflcation.  ,  .  '  .  ' 

d.  The*  entire  quantity  of  3.  t%  requiring  minor  tapnir  or  salvage  dts* 
posal  action  was  caused  directly  by  deterioration  due  to  Itr.^b  of  atorap. 


FOB  THE  CO.MMANDERJ 


r.  COFFEY 

Lt.  Ccloiiei,  Signal  Corps 

Deputy  Commander 
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SWBJECT.  E<r,ct*  «f  StcMn  m  lUltebUiQr  of  Bl«ir«iJe 
«wdv**rter..  Toby^^mu  Sir*!  Depot.  Tebyhoooo.  I>.on.,t«o|.  . 

ATTN:  SIGPD-6A  ’  ' 


«.  ToMt  Tom  procoosod  •  33.2SS. 
b.  Atitarbil  s«mpto  teiud '>  isio.i  ton*. 

«.  4%  of  tb«  oampt*  mttoMot  oe  «pproklin»t*)y  ps.  S  too*  ^joctod. 

*»  *  ro*uh  oAurosl!!*  ’'*^*'‘*‘*  *W»ro*lmol*J,  4t  ton.  w..  dofoctiv. 

.1*  Report^'^^M  Crnirol  SraboVsrMs' 

pereenuge  ftpiM*  were  derivod'h*  VentUp  ..mpln  tosfed  and  • 

PAD  Korn  835  ”d  ^  information  from  rtmi.iins  racorda. 

■  ROBERTO.  ANGSTER 
CoJonaJ,  si^l  Corp.  - 
Oommandinf 

tf 

StCOO'lO  (25  May  S8)  . 

^WECT:  Effect,  or  stora*.  «*  R,,^t«5;  Of 
0.«tnrSlgMlD.po,.Deca«tr.mi«,Ul2d«„.'»5.  •  '  •  •  , 

..  . . :  '■''•>»<»«« 


3529. 8 


-  •'•189B(0 

«.  Total  tons  processed  throueh 

Burve, nance  propram.  ,.»,  . 

K  _  .  *”•'*  3529.8 

"•  “Iwated  quinntir  sampj# 
wsiod  (Tons). 

,  -  121.2 
>ofb.  rejected  ameox 

**  »Ppro».  5% 

a-  >  of  f.  caused  by  or  as  ' 
a  result  of  storam 

«•  >c,sthan  1%  Jessthan  ,,3^ 


**  appro*.  5% 


fOK  THE  CO.MMaNDER; 


•vrcifoi.As  s.  ..vu.nson 

•Major.  .’Jiptia)  Co^oc 
Eseculive  Officer  ‘ 


-IjaMU 


SKl>t>>S«  XM?  34>  tst  M 

SUBJECT.  EfSrcty  at  Sttfagt  ea  Reilabiltty  ft  Klactosie 

L«t»fr-oa  Stc~*l  S«#ot  LMMftou.  Kcirtach^ 

TO;  Chwf  Siiia*}  Procurement  S  Oistribulion  Divisioa.  Deportmenlof 

the  .\rtnv.  SLue  N*««  But'>Oinf .  WMhmfton  25,  D.C.,  .\TTN:  S1CPS>-5A 

1 .  Reiereaco  it  maHe  to  ba*tc  eommunieatluA, 

2.  This  desee  ts  carra^Vf  ongafiul  in  procetsing  work  ioa<)«  of  such  voluma 

and  prionri  as  sr  creclvde  the  assignment  of  present  personnel  lo  Ow  pUoaed 
Mainsen»nce-is*i^.:'s^  S<.rrni,lar.ce  Program.  Ci»legory"E‘'  sad  "F"  dues  out, 
MDAP  and  Work  Order  Projecfs  are  heing  given  top  Priority  handling. 

Screening  of  s;.-*.  i  a;  caroeifion  with  ihe  NWO  rrc<j»-sin  is  the  only  plnnscd  Sur- 
veiiUnce*ii~.-S;orag*  treing  accomplished  at  present. 

S  In  ronnrruoo  wuh  this  program,  apprcaim.ntely  slit  bcadredend  eleven 
(6111  sons  rf  c.*r:rceic  a.nd  assocuted  equipments  have  been  modified  and  tested 
since  Match  HSS  The  equipments  involved  included  such  tteais  as: 

a'm-6S;'ORC  4,2S2each 

iiT-66/GRC  3.554  eaell 

n~  *T.T=v-  t.cii-iatb  -•  •  •  ,  . 

•  RT-M/QBC‘  1.(1?  each 
PP-109/GRC-  ;t1  each  ’ 

PP-112/GRC  -  531  each 

PP-282 /GRC  •  5. 5aS  each 
AN-'CRA-«  -  2T0each 
COtS.'VHC  -  13.05*  each 
R>t09/GRC  >  '  234  each  ' 

.\X,'T»S-1D  -  99  each 

AX,  VIA  1  •  -  2.S70each 

The  hulk  of  the-se  equ:;;e;eats  was  initially  received  st  'his  depot  during  i9Sl*19S3 
ftom  vendors  aad  nas  =«sn  retsined  tr.  permanent  warehouse  storage  stocks. 

i.  The  mod'.fiiraiu^  and  test  results  of  these  equipments  nave  revealed  tut  . 
occasional  tv;«  cresuge'.  sticky  r«lST,;^^^jMse  solder  joint  which  are  attributed  * 
to  Ihe  tn-manufaf-rae*-  process. 

•5.  The  Mo«.t!i-.fs  MC-29T.  208,  299,  300,  and  MT-327/aR  have  been  found 
in  ducrepar.cT  ui  that  t.'*«  u.ner  insulation  of  the  vidividusl.conductors  has  become 
b'lttie  and  flaky,  -tvs jsg  eiecirical  s.iorit.  This  condition,  however,  has  boen 
recognired  as  a  .'attr;  i=.ar.ufacturor’s  defect  rather  than  a  cause  of  storage. 

«.  Certain  .••.ner  -atepirirs  of  stocks  such  as  dry  batlerlee,  electrolytic  ‘ 
capacitors.  »!,d  sc.r-r,::  reciifiers  have  iievn  oaserved  with  respect  to  their  estab* 
lished  shelf  I.fr  at  ‘.lie  r_T<  of  shipment.  Other  than  requiring  test  and/or  re¬ 
forming  by  vi.-tue  =f  iNtir  shelf  life  dates  having  expired,  no  storage  dnftcieocies 
have  Ken  noted 

It  u  recc.priied  that  the  equipments  reported  herein  cover.onlya  portioa 
of  our  stocks;  hr»«cfr.  it  is  believed  that  the  over-all  condition  of  other  clocks  is 
rerecled.  ac.-t  sr-ce  y-c  .Vvrioration  or  il,  effects  as  a  result  of  storage  is  epperer.t 
on  these  cqjir.me-;.'  tt  is  c-;.eveo  tnat  tne  above  may  be  construed  aa  a  represent¬ 
ative  sample  of  eqcit-necta  m  stoc  k  »t  this  depot. 

8.  ITiis  derc-t  ras  ndgeted  for  monies  to  perform  the  aurveiilance  of  one- 
third  of  Its  sttf.-.vs  si-itg  rv-5'.  i.;tt;e  additioral  costs  would  be  involved  in 
nui.n'.au'.ir.g  recorcs  as  req-iested  during  the  accomplishment  of  this  program. 


■5^ 


FOB  THE  CC>it\LAX~£H. 


JOHN  P.  JOh.NSON 
U.  Colonel,  SICC 
Ovputy  Comma, -idtng  Offiier 


APPENDIX  B 


S.2  NAVY  •  BUREAU  OF  (XIONANCE  tUPFORTlNC  INFORMATION 


CYCLIC  INSPECTION  OF  FWE  CONTROL  tNSTRUMENTR 


INTRODUCTION 

A.  This  report  covers  both  Cts  s  "J"  und  “Z”  comrolied  Inslrumenls, 
stored  in  Building  No.  SO,  Bellevue  Annex.  The  quantities  anti  categories 
of  Fire  Control  instruments  and  material  are  listed  in  their  respect^ 
chapters,  as  per  insirucuons  in  O.  P.  IIOS. 

'B.  Building  No,  SO  is  a  type  one  (1)  storage,  taith  controUod  relottve  t»t<mf;*' 

■  Ity  of  approximatelv  thirty  f>»rrrrt  rili. 4.  oi  insini*  • 

;  •‘.tU  ...b  ouiwvJ  ue  eocMMin  paliets  and  on  special  designed  brackets  in 
metal  racks.  The  purpose  o(  this  method  of  stowage  is  to  prov'.de  convenient 
and  rspu!  means  of  periodic  manual  exercising  of  meehaniesl  romponents  of  - 
inslrum<ints.  without  the  necessity  of  removing  the  instruments  from  the 
pslleis  or  the  metal  racks,  lii  this  type  of  storage,  all  dckircants  are  rs*  ' 
moved  from  the  interior,  of  instruments  and  .equipments  io  allow  for  oner* 
filing  the  electrical  components  and  manuattv  Exercising  the  mechantcal 
parts  without  causing  damage  to  the  mechanism  of  the  instruments,  while 
conducting  the  cyclic  inspection. 

C.  At  present  .hero  are  3S4S  instruments  stored  in  BuildLog  No.  SO,  inittsUy 
preserved  per  O.  P.  .11.09,  for  type  one  (1)  storage,  and  carried  as:  '"Reedy 
for  tisue.-"  Semt'anm'sl  cyclic  Inspection  is  of  major  importence  in  order 
to  maintain  these  instruments  In  a  "Ready  for  Issue"  status.  ■ 

PROCE'uCAtS 

A.  Insttumenls  heving  mechanics!  components  are  msnutily  exercised 
monthly  in  order  to  prevent  them  from  bocoming’stt'l,  which  could  cause 
damage  to  deltcste  mechanisms. 

B.  In  the  course  of  conducting  cyclic  inspection  of  fire  control  instruments,  . 

special  ai’cntioii  is  given  to  the  proper  functiun  u’  both  electrical  and  nie- 
cnanlral  romponenls.  Tests  are  (a’rformed  by  cxjarrienced  personnel,  using 
numerou.s  etc.  Irical  testing  devices,  including:  Dummy  Directors,  Trans¬ 
mitting  a;id  Indicating  Units,  .Mcgijrrs,  Ohm,  Volt  and  Ammeters,  ahtch  are 
used  to  delect  malfunctioning  of  electrical  components  of  tlie  instrument,  and 
aUj  for  "irouole  stiooting.  ••  • 

C.  .VI mo rTc pairs  anJ  -djusfrents  are  made  during  T’.ts  insncction.  as  con¬ 

ditions  watrant.  All  covers  are  removed  from  (Ti  o'  the  'nsirumenls  to  per¬ 
mit  a  ihorojgh  and  complete  insfei-tiop  of  gaskets  to  detect  any  indication  at 
dctersorali.m  or  damagg.  AH  openings,  such  as  Icriniml  tubes,  are  sealed 
»:t!i  "Ca-l’Ings"  1260  thru  13gU).  At  this  time  a  complete  in¬ 

spection  is  made  to  determine  the  c midi'ion  of  the  preservatives,  takmg  into 
consideiation  the  ph.vsiVal  .  luricieri.sin-s  of  individual  instrumenis  and  the 
various  tyjx  s  of  prescrvaiivi-s  c.-.j-.-red  cor  pr-  ;-er  prose  i  vat  ton. 

D  Whore  «n5iri;fr.er.l;.  have  been  ini'.iall.v  preserved  a~  per  O.  P.-  1105,  for 
Type  1  Siorige.  for  a  l>crn>fl  of  three  {.V)  years  or  longer,  particular  atten- 
t%on  is  given  to  i.he  condition  of  ttuj  prestrvatjves  rel.iliv*  to  oxidation  and 
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tfryinxaut  of  lubrirMlt.  rhi>  iRsp«ci(M  also  includa*  the  UM  oT  Clo*L«mp 
(tMMiel  *94,  SwiUer  Oroa. .  tnr. ,  Clevelami  3.  Ohio)  to  deterntoe  the  eor* 
ditioM  of  moistJt*  and  ffn(<‘.<;  treatment  of  wiring  and  electrical  element*. 

In  the  event  there  la  any  indicattor.  of  rorroaion  or  fungu*  forming  on  the 
component  part*,  this  condition  ia  corrected  by  the  removal  of  the  corroaten 
or  futiguk  b/  proper  clciining  metboda  and  the  application  of  freah  prenerva* 
live*. 

C.  Upon  uisperting  material  received  fmm  ot’ier  naval  activitiea  in  a  "Ready 
for  Uaue"  itatua.  the  in,>pertion  ras  ahuwp  some  to  be  unfit  for  issue  to 
service,  due  to  poor  application  of  preser.  .lives,  or  in  some  cases  no  prea- 
ervattun,  c  racked  nr  discolored  « in  Jus  s,  defective  gaskets,  missing  perta  . 
and  uicorrurt  wiring.  On  a  number  of  occasions,  instruments  we.-«  received 
with  consiiierabte  shop  dirt  and  ottier  foreign  matter  in  them  such  as  metal 
shavings,  loose  screws,  nuts,  etc. ,  lying  in  the  bottom  of  the  instrument 
case,  the  presence  of  which  could  cause  damage  to  delicate  mechantems, 

1  he  above  r.re  only  a  few  of  the  defecta  noted  on  inspection  of  fire  control  ■ 
instruments  received  II*  this  activity.  In  ISS2,  a  quantity  of  Indicator;',  Gull 
Elevation  Mk  23.  and  Gun  Train  Mk  Z3,  were  received  in  a  boxed  conditiott, 
having  been  m  tong  term  storage  since  iii4S.  These  instruments  were  found 
tu  he  mechanically  inoperative,  due  to  froxco  shafts  and  gearing,  caused  by 
hardening  of  the  service  lubricant  first  applied  by  the  .manufacturer;  AH  (rf 
these  instruments  required  overhaul  prior  to  issue.  If  theM  instruments 
had  been  mechanically  and  electricall/  exercised  at  regular  perioda,  this 
condition  could  have  been  prevented.  Where  possible,  personnel  of  the  ■  . 

Technical  Division,  Supply  Department,  have  corrected  aiich  eonditlons  cm 
a  large  quantity  of  fire  control  inatrumenta  received  from  other  actlvitieil  * 

10  order  to  pU>'e  them  In  a  “Heady  for  Issue"  stafes.  .  ’ 

*  ■  ^ '  r 

K.  bi  I9S2,  twenty-five  (23)  Gun  Dlrc'ilor<  Mk  51*3  (Ready  tor  -liiwue}  were 
received  from  another  avtivlty.  An  iospectien  revealed  that  some  had'coO' 
jidenible  fungi  on  wiring  and  Wriniral  slripa.  tocaled''in  the  pedestal  Stand.  . 
Several  had  badly  rusted  center  columns.  All  required  initial  preservstioft 
and  overhaul  prior  to  issue.  This  eootiition  was  caused  by  failure  to  seal 
off  the  ,ai  tube  opening  at  the  base  of  the  director  pedestal.  Some  . 
items  a.  ,  c«.  -(ved  with  incorrect  prea<>rvation  data  on  inspection  tags,  a* 
taCbapier.  Hlan  or  Method,  ns  per  O.  P.’ tiOS  inslntcUon*. 

C.  When  fire  rontr;l  instrum',  its  are  first  rvLOived  In  Building  No.  SO;  the 
insiruments  are  opened  and  a  thorough  and  complete  inspection  ia  made  to 
determine  their  serviceabilily  and  condition.  This  inchides  a  check  for  indi* 
cations  of  contan.ination,  fungus  or  corrosion,  and  the  condition  of  preaerva* 
tivis  .Mechanical  and  electrical  com{>oncnts  are  tested  *.o  determine  (hat 
they  are  functioning  properly  and  for  determining  any  defects  noted  in  the 
general  condition  of  the  instrument.  A-complete  instrument  cbndition  re*.  ' 
cc.d  card  (Fire  Comrol  Instrument  Inspection.  PRNC-NOF-lliB)  is  main* 
tamed  for  the  purpose  of  conducting  ar.  adequate  cyclic  inapection  program. 

IN'.>rFCTIONS  'on  titi.truments  iitiiially  preserved  in  eccordance  with  O,  P.  IIOS) 

A.  O.  P.  1105,  Chat»t»*r  6,  .Type  I  S’orage 

Vuentily:  723  •  tnilially  preserved  in  accordance  with  above  chapter. 

Instruments 


bid.  Regulator.  Gun  Eiev. 

Receiver  Regulator.  Cross-Level 

"  "  Cun  Train 

f4 

Elevation 

"  "  •  Fute  Setting 

•4 

"  .  Fuse  Setting 

"  "  Gyro  Setting 

"  Cun  Elevation 

Power  Drive,  Ftevalion 

"  ■  Gun  Train 

Power  Drive,  Train 

II 

’•  Train 

Reducer  Error 

H 

"  Director  Train 

Sigl.t  Slewing 

3C6 


Frequency  of  cyciU;  nupectioii:  Senii>«neuel.  Quentily  cyclie 
tnspecled  •  S%;  q^enti^r  Meryited  and  operated  •  100%. 

Inslmmenle  that  are  opened  for  inapection  are  o'oaerved  cloaely  for  deiert* 
oration  on  critical  peria  ouch  as  fei.ra.  afaafts,  beerlnga  and  other  hifhlj 
finiihcd  surfaces.  iClertrical  component'  are  inspected  for  tunyua  and  con* 
tamination.  Preservatives  are  inspected  for  oxidation,  dying-out  and  pH 
factors,  particularly  uhere  nonf.irrous  metals  bear  on  ferrous  metals. 
These  instruments  aiv  divided  into  two  classes:  (1)  elecirti  hydraulic  and 
|2)  electrical  mechanical.  Hyd.'aulic  preservatives  are  checked  (or  acU) 
content.  Any  di.<:crepancy  noted  during  the  inspection  is  corrected  iir.medl* 
-otely  by  the  Inspecting  personnel,  if  within  their  capacity, 

r«.  O.  P.  1105.  Chapter  10,  Type  I  Storage 

(^lanlity  SI  •  initully  preserved  in  eccordancr  with  above  chapter. 

Instruments 


Compensator  Motor  Amplidyne 

Controiter  Motor  Generator  Amplifier 

Coniro.  Panel  Relay  Cabinet 

Firing  Panel  Mu'ior  Control  Unit 

Motor  Alternator  Amplifier ' 

Frequency  of  cyclic  inspection:  Annual.  Quantity  cycliC'  inspected  and  . 
electrically  eiergiied  -  100%. 

The  physical  characteristics  «{ the  above  material  requires  that  all  covers 
be  removed  prior  to  conducting  an  eicctrical  test  for  determining  senricC' 
abihly.'  At  this  time  a  thorough  inspection  is  made  for  delecting  any  indi¬ 
cation  of  corrosion,  fungus  or' other  contamination.  In  the  event  any  of  these 
eond'*  -IS  exist,  and  it  is  within  the  capacity  of  the  inspecting  pe<*oimel, 
the  cc  aition  is  corrected  by  proper  cleaning  and  the  applicniion  of  preserva¬ 
tives, 

C.  O.  P.  1105,  Chapter  5J.  Type  1  Storaie 

Quantity:  35  initially  preserved  in  accordance  with  above  chapter.'. 

Instruments 

Compiih'r  Mk  6  A  Modi  Searchlight,  Trunnion  TUI  Corrector 

Frequency  of  cyclic  inspection:  Semi-siinusl.  Quarlity  cyclic  inspected  - 
5%;  quantity  manually  operated  -  100%.  . 

Since  the  Computer  Mk  G  is  a  mechanical  type  uf  instrument,  without  elec¬ 
trical  components.  It  is  mechamcally  exercised  monthly,  due  to  the  fact 
that  the  instrument  contains  a  raerharical  clock  mechanism,  which  requires 
reHindini;  and  running  to  prevent  the  spring  from  becoming  set  AU  mput 
knobs  are  exerci.sed  to  prevent  hardening  and  seltmg  of  preservatives'snd' 
lubricants.  Instrumems  are  inspected  for  corrosion  on  critical  parts  such 
as.geai's.  shafts,  bearings,  and  other  highly  finished  surfaces.  Farticulai- 
atteniiun'  is  given  to  oatdatiun  and  preservative  pit  factor. 

U.  O.  iiuo,  c-napter  54,  Type  1  Storage 

Qu.tnliiy  26  -  initially  preserved  In  accord.nnce  with  above  chapter. 


CtoOMM.  SMbt.* 


V«rtie*l.  SUM*  Uait.  StubiUnag 


s?^s»“'.22.%“s;;£  r  “ss'  ■ 

”S;“  ^esis 

«i!l »b«re  .w.Ii.d  to  non-ferrous 

«eh  other.  ««h  ..,e.r».  worms,  etr.  Close  stleTion^^Xto  Ml- 

HiS:-SHS5^1 

"•  P-  **-  »tC5.  Chapter  Si,  Type  I  Sloregw 

Queotlty:  2*CS«  -  hUtfaUy  preserved  in  sceordsnce  with  shove  chspler. 

tnstruments  •'  .  ' 


Trsnsmitter,  Baitl* Order. 

Gun  Elevation  Order 
^  •  Cun  Train  Order  Eelay 

»  • 

Kance  Spot 
SearchUcM  Cemrel 
SearcMiiM  Elevstioe 
■  Searchliihl  Train 
„  Siahi  Ancle  d  Oeflecliw 

^  Star  Shall  1^ 

„  Tercet  DesicnstlMi 

„  Tercel  Oeai|nstion  Ree. 

^  Train 

„  J*'**"  ®*aiinatlon  A  Relay' 

Wiftd 

Selector  Drive 
Correclera 
Oesicnaior,  Train 


tadlcator.  Raltle  Order 
«  Beartaf 
^  Resriec  A  Ranee 
Oireotor  Clevatien 
Oitceior  Train 
Clmtien 

^  TaeeSettioc 

Can  Elevation 
•  Gun  Train 

Multiple  Terret  Train 

„  ' 

Repeater  Taryet  Ancle 
Searchlicht  Elevation 
Searcklicht  Train 
^  Sicht,Setter 

^  Tar^  Course 

Torpedo  Course 
"  Train 

Ji— T»ansmitier 
Receiver .  CIUDfe  of  Ranye 
»  Ranye 

„  fcarchlii^t  Order  ReUy 
^  Sight  Acfle 
^  Slight  Deflection 
» 

.  Target  Besriny 

divided  l«to„octa..e.:  (1) 

tr.^  Mechwicaj  Cl»»s^AIl  electrV/*i*  7S%  are  in  the  Elee- 

Chan,cal  parts  e»rc«ed  '<>- 

coir.p<jn«nls  properly  A  il  r  >  »nd  inecheniral 

IndKa.ion,  of  m«de  to  d,»ecl 

:-«crcpar.c„s  :hs.  Ly  have  -c«Verh::;%,trSX^ 
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Th*  lnttrum«at$  opened  or*  impoeted  to  dettmilM  condition  ot  pt'ooorvs*  - 
fives  roUtivo  to  lodtcsttotto  »t  laiidatiM  and  aetdaty  effoctinf  lubricania.  In 
tiia  event  of  ?e*ro*iaR  or  \ngu*  on  mechanical  or  electrical  etemema  of 
these  inatnimenu.  :hey  are  cleoaad  and  t*>pr«a«rvcd  accordiii(  to  ciirrent 
dArectiyea. 

F-  O.  P.  IIOS.  Chapter  5t.  Type  1  Storane 

Quantity:  54  >  initially  preaenwd  in  accordance  wttb  above  chapter. 
Inatrumenta 

Director.  Gun  Mb.  $1  4  Mods. 

Director.  Cun  Mk.  57  4  Mods. 

Director,  'torpedo  Mfc.  27  4  Mods. 

Fretfjeocy  of  cyclic  inatMtetiao:  Semi-annual.  Quantity  cyclic 
inspected  -  5%;  quantity  eoerctaed  and  iqicrated  100%. 

'  Torpedo  D<rectora,  bavinf  a  coopjas  electro-mechaaical  romputind  and 
ioilam  up  machaniam.  require  MitUed  and  eaperienced  peraonnel  to  operele 
and  to  delect  faulty  operaticio  in  the  electrical  and  mecl^nicat  cetnponents. 
Fariicuiar  atleulion  is  fiven  to  the  condition  of  presarvacivca  nod 
"hardeninc”  and  dryiiid-out  of  icbricanta.  «hicb  could  cauM  matfunclioii  nf' 
the  hijUy  critical  mechanisms.  If' cerrosion.'or  contamination  is  detscisd 
on  crItiLsi  metai  surfaces,  it  is  removed  by  usinf  proper  cieaninc.materihl* 
and  t^e  application  of  a  it^ht  cent  of  preservative.  Electrical  tradamitlinf 
units  of  Cun' Directors  are  etierjpsed  and  iestetf.  All  mechanical-  compo¬ 
nents  are  manually  eaerCMcd.  Methanical  and  electrical  components  ant 
thoi-outbly  inspectodXor  rorrdsioci  fungus. 'or  contamination.  Inthecvonl 
any  “breaUnd  down"  of  piesorvathrea  ia  doiected,  this  condition  ia  cor¬ 
rected  fay  inspection  parsonntt.  -  - 

IV.  SUMMARY  * 

A.  Cyclie  inspcctioo.  as  described  herein,'  is  accotiiplished  by  one  Rack-  ^ 
a(ind  and  Preservation  Inspacior  of  the  Teehnical  Divisica.  Supply  Deport- 
ment  and  two  olectricians. 

B.  The  nature  of  the  tnspoctor'a  dutiea  not  only  require  a  tboreudb  knovl- 
edfo  of  various  typos  of  preservatives,  applicable  to' fire  control  inalm- 

■  menis.  v'.’t  also  the  correct  methods  of  conduciind  a  physical  inspection  for 
determinind  the  condilioo  of  mslrvmentj  relative  le.indirationa  of  <v>r-esioa. 
fungus,  or  ether  types  of  coMmimlion. 

C.  Since  there  is  a  larde  quantity  of  various  types  of  fire  conlrol  inslm- 
ments  stored  at  *his  activity,  a  detailed  kmrirlrdde  of  the  purpose  and  func¬ 
tions  of  mechanical  and  elect;  teal  components  of  these  inslrumanta  ia  es¬ 
sential.  also  a  comprahenu.ve  knowledge  of  tnterpreiir.,  electrical  and 
mechanical  dlagrama  and  prints,  in  order  that  the  pMper  testlnd  equipment 
may  be  utilized,  and  the  results  of  these  tests,  as  indicated  by  instrument 
readings,  be  readily  vnJerstood.  Any  incorrect  readings  or  operational 
failures  are  corrected  by  making  the  necessary  adjustments  and  repairs, 

tf  within  the  rapacity  of  me  Bsprc'or 

O.  AH  fire  control  equipment  stored  in  Ruildmg  No.  50  is  given  a  physical 
ir.specticr,  a!  Ine  time  of  receipt  to  dMermine  its  condition  and  serviceability. 
In  ad '‘•turn,  at  t-w  time  of  issue  to  service,  each  fire  control  instrument  is 
again  ■.-..'Specied  to  deiermice  if  it  is  st,.!  in  a  "Ready  tar  tsst-c"  status. 

E  Tne  past  ftv<;  (5)  jeirs  of  performing  cyclic  inspeclions  have  revealed 
that  prc-5<.Tv«|;ves  used  in  fire  control  insfPTner.i.s  Jiold  up  very  weM  in 
Tvoo  •  ,  f’reservativo  lailvre  is  negligible,  dut  to  the  eyetJe  In- 

speriion  and  ir.a Inienance  programs,  conducted  at  this  activity,  '.vhem  five 
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•**  ***■  ‘"»r^“«>«  •fti  rtir»$*nmd  m 

It  *"**'^*“‘*  *»rr«nt.  Psnicular  atwniion  U  fivcn  to  ^  » 

t  th»t  hav*  teOutlr  arcaarvad 

X,"  Sri'  TXAITu^'  "'■■''“•I/ 

Li  •  five  pe.  rent  {J5«)  ef  the  tnsintment*  npeneO  for  3s:istiu^  t,irm 

s,7“c7^r.iL’!if  »«» 

Tor  ***  ‘"•‘rument*  to  the  Ihops 

nn>wri«rof  »"  “VW*  of  considerable  funds. 

majority  of  merhinirul  snd  eleelrirat  defects  are  rerreried-ai  the  time  e# 
mspectfon,  this  reducin,  the  necessity  for  silnplter^l'^J  ** 

F.  Inspections  of  tnaterisi  receKod  from  other  asvst  scttviiies  alien. 

“efc^r'd^  m  ^  «W»««ly  in  long  term  stomse,  revesle-  cot^sttiJISl. 

menw  i  «vf  »"<*  contaminated  condition  of  instni- 

u«n  testtei  .he  eo  '.^»f<»»Vo«ents  and  faiijly  operations  »ere  detected 
«ptn  testing  !he  e^jipment  for  sor>'»ceabUit>. 

f'’’**.'  *"  '•'““•f*  »»*«  •Jactrical  energiting  and  eaercising  of  fire 
***^1'*!!*.?“'  ***'‘“‘  eleclrirsl  connection  adaptors  were  designed 
a^  r<msf reeled  by  on.  of  the  Technic. t  Division.  Suprl  Itepartmwf  ^r- 
soaitel  and  a-  electrk««.  By  me.n.  of  these  a iptors'fire 

If.  From  past  eaperience.  obtained  during  f^  veara  of  oertermine  niliie 
•lASpertidn  o/  fire  controf  instrameots  et  this  activity  ft  Is  recomme^L 

n" S-i  --srsss.  • 
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S.  3  NAVY  -  aVBEAL*  OF  5MIFS  StPPOHTJKC  KFOKMATION 
theluded  la  tbi*  appendix  arc  :h«  faBoaieg  iteind: 

I.  Notea  on  Bureau  of  Shipa  Cteetrenie  Equipment  Failure  Tabulatfoa 

II.  Sample  Failure  Tatulatioo 
ill.  Failure  Report  Form  DD-1B7 

IV.  Supplementary  Codes  for  Type  at  Failure 


1.  Noted  On  Bureau  at  Shipa 
Electronic  Equipment  Failure  Tabulation 

4 

Cquipmem  Contractor  by  Equipment  Model  by  Part  Reference  Deaii;natian 
*  I 

1.  This  liatinc  la  arranged  in  aacendmg  alpha-numeric  arquenre  by  rqutpmeiit 
model.'  Uithin  each  equipment'  model  categisry,  the  data  to  arranr,ed  in  aaeending 
alpha-numeric  aequence  by  Pan  Reference  PeoignatiaA. 

2.  Each  line  of  data  repreaetita  one  DD-Tt?  Electronic  Failure  Report. 

}.  The  data  for  each  column  romea  from  the  boxea  i«  DU- 707  aa  naira  no  (fte  , 
apreimen  altect  .  -  •  ,  ■ 

4.  The  Total  Failure  column  contains  a  total  by  Part  Rrfrrci.re  DeBignalion.  a' 
total  hy  Equipment  Mode),  and  a  total  for  alt  eqaipmenl  model*.  The  iailcr  total 
ia  followed  by  a  "plua"  aign. 

5.  The  complete  Hat  of  coder  uaed  for  "Type  at  Failure"  (DD-7#7.  Box  No.  30) 
is  atiarhe'd  hereto. 


I 


3J.  Wur.  Um  lift  MfiUmd 
ttirlnjj  mMnttv* 


IV.  SuppUnwattry  Codtt  for  T>p*  pf  Pouvro 


OOt  -  Ooosy 
U03  -  Airload 
003  •  Open  fUAnn*ii| 

004  •  Low  emtaaion 

OOS  -  Shorted,  intormlilont 

00«  » Shorted,  pemanent 

007  •  Areint 

001  .  Noiay 

009  •  .Miorophonic  , 

010  •  Poor  focur 
01 1 .»  Sereen  defect* 

Oil  •  Lease  element* 

Oil  •  i.oo*e  has* 

OM  -  Srekan  base 


01 S  -  Broken  ciata 
016  -  Class  strain  ‘  • 

Q17  -  Result  of  other  cempooenl 
failure 

*  Tested  OK.  did  net  work 
010  r  worn  eacessiielp 
Oil  *  Overloaded 
Oil  -  No  oaeillatien 
031  •  Alignment,  improper  ‘ 

0«0  -  Methanieel  binding 

050  •  Blistered 

060  •  'Brittle 

OfO  .  Broken 

080  -  Burned  rut 

22?  ■  Sf”*’^**  ^proper  tension 
099  •  Other 


100  •  Brushes,  hard 
tin  •  Brushes,  soft 
120  -  Chafed  ‘ 

1 30  -  rltange  ef  value  .  . 

UO- Charred 
150  -  Chattering 

connection  defectiv'* 

170  -  Corroded 
180  •  Clogged 
190  •  Cracked 
200  -  Denied 

1 10  -  Detent  actin-i  -  poor 
720  -  Defective  spring,  toggle,  arm, 
IJojar  rnvsho  bearing 
22.S  -  Manufacturer’s  defect* 

230  -  Dirty 
235  -  Dry 
240  -  Flaking 
250  -  Frayed 


HO  -  Prietiun  •  eiceastve  ’ 

270  >  Fmten 

•  280  -  Kungu*  effect 
280  >  Grooved 

300  •  Grounded 

310  -  Handling,  improper 

*20  -  High  voilage  breakdown 

330  -  exetative  hum 

340  •  installed  improperly 

3S0  •  Insulation  breakdown  i 

360  •  Intermittent  breakdown 

370  •  dammed 

'380  •  Leakage 

400  •  Loss  of  rceidusl  magnetiam 

410  •  Lack  of  lubricatton 

420  •  .Moisture  •  saturstten 

430  •  Oil  •  saturation 

640  .  Old  age 

450  -  Open 

410  •  Open  primary 

470  •  Open  aecondary 

480  ♦  Ovei-beated 

500  •  Over  •  lubricttion 

510  •  Pilled 

$30  •  Polarity  reversed 
540  •  Punctured 
560  •  Poor  regulation 
STO  •  Rusty 
580  •  Shock  . .  .  ■ 

800  ••  Shorted  to  esse  ' 

810  •  Shorted  to  frame 

815  •  Shorted  to  gruund  ■■  • 

820  -  Shorted  primary 

630  •  Shorted  secondary 

540  -  Slippege 

64$  -  'tpurious 

650  -  .Sticiqr 

640  -  :>tripped 

670 '• 'Jnbalaneed 

680  •  Unstable 

PrO  •  Vibration  •  ckcetsive 

700  -  H>sk  •  electrically 

710  •  (tesring  failure 

710  •  Brush  failure 

730  -  Loose 

•  SO  -  Missing 

770  -  JLp  ring  or  commuuior  failure. 
760  -  fient 

790  ■  CXii  of  adjustment 
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ehumtn  m  S*jjdu  Corpcraa^,  “•  I*  «>  fUt  to  th*  ore*  of  to*  T*»k  Gr««p5« 

U»  tociution  her*  oauM  h«iM  .>.1 

f*^ir«4  thu  r«port  to  b»  cl*««tfi*4. ' 
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5. 6  SA.VDU  COKPORatION  .IIPPORTINC  iKTORMATlON 

r*P(jf7*re ‘““fi't  tolU^ttjIuw  a"**^*^  *"**  to  Seciten’  2  4  T  of  tkto 

Tiy  con,i„  of:  •  A«„«nc.  0.p4««,„,  ^ 

r.«cc<rd  todJlV*.  ‘"*I»<UQR»  to  bam  e«rd  form  *od 

».  EAMT.^n:o,  .' 

Milure  w  ccwpoUttons  tor  *»tinyi.to*  MltabUtty  to  »r«!»  of 

<jf  Tab  runs  m  a;^n-,”c  «^r.»nre  to  conlant  (e«»-  .j;;  -  ^ 

not  included  w  thji  •pp^nduc.  F'.jri>'erm/>i^  reports)  thet  thJ^Cre 

Itecume  cU*5ified  restricied  d*u.  ’  assembled  togeUier  theft  <^t4 


■  *“->'O^ARy  HE.fWT  OF  TASK  GKOUP.*  ; 

Jl«rold  y  loM.  P.  XitlMtfhy 

W<»«Str«el,  N,.»  York  14,  N.  Y. .  rf»«rd <« 

MjwM  hy  youTra^ oft  CKE^*^  and  »f»arHi>d  preliminary 

*■’/.  inclusivo,  are"*  »»*«c*ai«d with yoor  Rer-immenUaHonn  4.  }  tr. 

de'alrrtt*  ‘*“*’**“-’'  >"o»»  mUiUry  u.nts  lt>  supply  all  i)*,  ’ 

(b)  SeWcilveneCstrfda.u,  lossoirdam,..  ‘ 

pfK;93r3S;rt“ 

-nvoMi^niions,  ' 

-n,H.'-,hen  M^raTonr  ^■‘coll^^rrr’  «>««,«  Is  ra,.,,v.l, 

actors  and  extensive  study  would  not  ‘^“'"Pared  to  other 

m.xfesl  engwtvr,^g  *'*' '"  bo  small  • 

auch  failures  .ha,  would tttworrt P‘-"’-a«-y  f.ruS 

stth  i'"‘  ^  "’**'"'*  '•°P*«a”in^iffcren,  ^  "’*‘**'  Probably 

SLrh  a  survey.  •  ‘t'W*  to  set  a({r««ment  to  ronductln*  ' 

degree.  comments,  and  I  trust  «.».  ;hcy  r..ay  be  helpful  ,n  somo 
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f>.  a  NOTES  ON  SHORT  SHEtP'UKE  ITeMS 


Short  she!f  -lif«*  I'i  a  serious  firohletn  In  connection  w*th  lirjr Itatteriea.  selenium 
rerttfiors  ar.tl  electrol>tw  ra{Mcltora.  to  additioft,  the  foUorinf  (lerlJ  present 
less  scrio-'s  problems 

a.  .  Face  '  Shear  larad-Attaclied  Crjiatala: 

■riie.se  comprise  approximately  5  per  cent  of  the  qjsiis  crystals  in  use. 
fevcre  egtrg  in  ns  little  as  one  .tear  may  be  expected  among  those  protluced  by 
cortoir.  mamilac  turers;  those  pro<)tii;ed  by  other  manufacturers  also  age,  but  more 
stoivly.  Other  types  of  <(uarta  ctystals  present  no  appreciable  aging  problem. 

b.  Transistors': 

There  is  no  serious  problem  in  connection  with  transistors  except  for 
the  products  of  ccrt.-iin  manufactur.'rs.  This  is  apparantly  ihie  to  the  methuds  of  • 
manuf.iciure  and  oi  handli/ig  employed. 

c.  Crystal  Diodes: 

The  comments  on  transistors  apply  to  crystal  diodes,  but  to  a  fasitcr 
extent.  ■  •  .  ' 

d  “here  is  also  a  long  range  problem  in  connection  with  changing  values 
of  carbon  resistors  and  lli-K  fa|..ir iters,  however,  this  problem  does  bo*  become 
*  serious  until  these  items  have  teten  in  storage  for  live  years  or  more. 

(Other  than  refrigerated  storage  for  dry  b.xtteries, ' short  <siielf>lift  items 
receive  no  special  .storage.  An  increase  Ui  temperature,  hosever.  Murreases' the 
rate  of  deterlo-ntion  of  the  above  Ueii)s  ) 


Art'cnufii  I 


5. 8  PBOFivgD  PROOBAMS  FOR  OBTAlNCfO  DATA  DM  rttr 
RELlABliSiTf  oif'  ELRCTR5n1C  EQUIPMENT 


I  Shert'Rjiai*  Pro4P’am 

NorntncUtur#  0.“  tm  luimbAr  of  o<|ulpm«ni. 

Numbur  tc^tod.  ~  . 

Number  arceiRed. 

Number  feMinj  to  |>e»e  teets  before  repeirend  w  trf  • 
f^Jure  on  each  (e.  g. ,  shorted  rspecltor,  op^bdlo 
transformer,  open  R*P  coll/  etc. ). 

Serut  number  of  each  e<|uipment  that  fails. 

Each  e^i^ent  tasted  and  returned  to  stock,  regardless  • 
^w^ther  as  a  result  of  recerUficatlon  or  of  Mpalr~ 
be  stamped.  Tested  and  Passed  (REP.  TM.  etc!). 

Test  requirements  (date),  '  .  , 


^  l^nt'R*nfe  Program 

•ny  defect  found  occurred  durtoi  ***“.? 

" ""  “““•  •“  air'/Ssr. 
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METHODS  AND  PROCSDURES  TO 


ASSURE  RELIABLE  EQUIPMENT  PERFORMANCE 


PREPARED  BY 
TASKGTOUP-9 


JANUARY  «,  1957 


TOREVOm 


Over  the  past  decade,  niUtarr  electronics  sjrstcss  have  become  increnslefllf  com*  ‘ 
plex.  Since  high  performance  u  the  field  remains  essentia^  the  mtnteminct  of 
this  e<tuipment  has  become  a  se/ioos  probletiL 

titliile  considerable  attention  is  being  devoted  to  design  for  tnberent  reliaMtl^,  it  is 
also  necessary  to  devise  a  maintenance  program  ateh  aiU  inamre  Urn  fait  bciufiU 
of  a  system's  inherent  retii^il.ty  are  realued  ia  the  field,  b  order  to  achieve  U;l«  . 
goal,  it  is  necessary  to  explore  all  possible  methods  of  improviag  the  mabitf  naacs 
programs  employed.  -  • 

Overthe|»styear,  Task  Croup  9  has'deiroted  its'cfiotttto  studg  of  the  matatcaanee 
erebiettt  thiough  invectigatlons,  discussions,  and  by  tevitiag  esperta  ta  the  fitld  to 
group  meetings  for  presentations.  To  summariae  this  effort,  this  report  had  been 
prepared  arhich  ' contains  recommendations  to  the  Oepartment  of  Mease  on  maay 
aspects  of  the  maintenance  problem  supportedby  details  and  rtfereacas  !•  all  phase* 
of  our  work.  Our  recommendations  of  necessity  had  to  be  broad  in  concept  since  ’ 
the  maintenance  problem  differs  for  each  milHary  department  and  for  each  elec> 
tronic  system.  Consequently,  U  was. not  possible  to  make  rccommemfalioM  fvch 
as  specific  training  courses  or  mauttenasce  procedarse  for  specdic  systems. 

The  materul  contained  in  this  report  is  as  mtegratiow  of  many  prriiminsry  reports 
and  attempts  have  been  made  to  ebsmate  excessive  detaiL  However,  details  of  ail 
preliminary  reports  can  be  found  in  minutes  of  the  group’s  meetlags. 
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The  Advisory  Group  will  monitor,  ttiraulats  interest  in,  sod  advise  on  relMtU^ 
matters  «itiun  its  (letd  of  interest.  The  field  of  interest  of  the  Advisory  Group  M 
Reliability  of  Electronic  Equipment  will  include  relhihllity  matters  in  etectrosic  equip* 
ment  design,  development,  procurement,  prcduoilon,  msintenance,  iss(t:dlat!0B,  eperiUiMi* 
and  training. 

Recommendations  and  comments  of  the  Advisory  Croup  will  be  stdtmittsd  for 
consideration  and  initiation  of  appropriate  action  to  the  Director,.  Office  of  Blectrosies 
and  Guided  Missiles,  Office  of  the  Assistant  Secretary  of  Defense  (Eegineeriogji 

Task  Group  *t.  Develcp  mlnlmum  'acceptability  figures  for  rellabili^  of  the-  various 
types  of  military  electronic  equipment.  These  figures  possibly  may  be  ekpressed  ss  . 
“time  between  failures'*  or  some  other  t.  .ay  quantitative  measurement.  The  basis 
upon  which  the  figures  are  determined  slult  include  the  factors  of  operatiosat  missies 
requirements,  maintenance,  eompi^xity,  and  stKh  other  factors  ss  may  bt  signiftesat 

Task  Croup  *2.  Deveicp  basic  requirements  for  tests  to  be  accomplished  on  drvelepmeMi 
models  which  will  prove  that  the  design  Is  capable  of  meeting  the  minimum  acceptsMUly 
figure  for  reliability  established  for  the  equipment  type.  These  tests  shall  be  designed 
to  be  performed  either  in  addition  to.  or  in  cuijimction  with  whatever  performance 
evaluations  are  specified  for  the  equipmenL 

Task  Croup  *3.  Develop  basic  requirements  for  tests  to  be  accompUsbed  on  pilot -pro*, 
duetton  and  on  production  models  which  wiU  prove  conclusively  that  the  equipment  will 
meet  the  minimum  acceptabJlty  figure  for  reliability  established  for  the  equipment  typs. 
These  tests  shall  be  designed  to  be  performed  either  in  addition  to  or  in  conjunction 
with  whatever  performance  evaluations  and  operational  suitability  evaluailau  are 
specified  lor  the  equipmeot 

Task  Croup  *4.  Investigate  and  recommend  methods  of  specifying  development  procedure* 
to  Insure  that  equipment  designs  will  have  the  inherent  reliability  required.  Some  factor* 
which  might  be  ic'olved  ate;  (It  theoretical  reliability  prediction.  (2)  tborough  component 
selection,  qualifi.tation,  and  application  for  specific  circuit  and  environment  require- 
mciits,  (3)  adequate  S!gn;il  levels  and  feedback,  and  (4)  minimizbig  the  effects  of 
mechatiicai  shock,  vibration  a.id  temperature  on  criucal  components. 

Tar;:  Gr,  p  #S.  Establish  criteria  and  methods  for  specifying  the  reliability  of  com¬ 
ponent  pai 's  and  tubvs  in  terms  of  failure  rate  as  a  function  of  time  and  environment. 

This  IS  considered  essential  ho  a  determination  of  the  amount  of  •mproveirent  demanded 
in  various  components  to  meet  the  over-all  reliability  requirements  of  the  vuriou* 
types  s!  electronic  equipments. 
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nuk  Croup  #8.  Studf  present  procurement  and  contracting  practices  and  mgnlalioos  to 
determine  their  eompniibUitp  with  reiiabiUtjr  objectives.  Make  recommendations  tor 
apecKic  changes  as  (o<md  neceaaatf  during  the  stu<^.  Some  of  the  (actors  involved 
might  be:  (1)  assessing  the  imptementation  of  000  Directive  No.  4105.10.  ''A»plt> 
Ccaiicn  of  Policy  Governing  Award  of  Initial  Production  Contracts  (or  Technical  or 
Specialized  Military  Supplies*',  dated  March  17.  1955.  12)  methods  of  selection  of 
contractors  (or  development  and  production  and  the  possibilities  of  Ineluding  evalustios 
of  the  potential  contractors'  abUUy  to  produce  reliable  designs,  and  (3)  evaluatlOA  of 
combbied  R&D  prod->et!on  contracts.  (4)  in  considering  award  to  lowest  bidder  -  Iho 
over*aU  cost  including  operation  and  maintenance  might  be  considered  (might  bs 
determined  on  basts  <rf  predicted  relisbUity):  > 

Task  Group  #’l.  Investigate  present  practices  cf  packaging  for  shipment  and  trsns- 
portatlon  methods  and  recommend  specific  improvements  whleh  will  enhsnee  reltsbllltT; 

TaNc  Croup  f9.  Investigate  the  effects  of  storage  of  electronic  cquipmeBt  upon  r*> 
liability  and  recommend  improvements  where  desirable. 

-  Task  Group  49.  Review  present  metheds  and  procedures  to  assure  that  the  reliability 
of  equipment  in  service  is  kept  up  to  the  inherent  design  level.  Factors  addeh  might 
be  included  are:  (J )  maintenance  baaed  on  perlormance  measurement  rather  than  to 
meet.rigid  time  schedules.  (2)  marginal  testing,  and  (3)  persomtel  training. 


,.ii.>-»iA-=J»art»i"!>*i.  .*Mjii«iM<i>Wi^ 


1.  SUmiARY 


Tht  purpcw*  ot  raaintenanc«  ia  to  auatiln  ;:»sisncd  performance  antf  coteinut# 
operation  of  ^ulpment  and  ayslema  in  order  to  attain  the  beat  degrne  ot  operational 
and  material  readineaa. 


&lainlenance  ct  electronic  equipment  la  depemient  upon  aucb  factora  m 
equipment  maintainability,  peraonnel  training,  atandarda  and  proecdurea  ter  dweWag* 
equtpoiunt  performance,  preventive  maintenance  procedurea  and  quality  of  airport 
material  auch  aa  technical  manuata,  teat  equipment,  and  teat  facitutea. 

Study  of  the  ovcr>att  maintenance  picture  verMiea  that  malor  engtoeertag 
effort  muat  be  devoted  to  Improvement  of  inherent  equipment  reliability.  Moewrer, 
the  deaigner  muat  thoroughly  consider  the  maintenance  ot  his  equipment;  be  OMSt 
also  minimize  the  requirement  for  highly  trained  peraonnel  in  the  field  and  redbee 
complex  maintenance  procedures  If  high  performance  ie^to  be  attained.  - 

to  aaaiat  the  designer  in  this  arts,  it  is  important  that  a  rigorous  operrtiotial' 
definition  of  nmimainability  be  formulated.  Once  defined,  t  maintainability  retialrement ' 
should  be  included  in  the  apccificaiiona  for  each  new  system.  When  the  system  ia 
undergoing  its  evaluation  tec's  prior  to  quantity  production,  its  mamta'naliility  aboutd 
be  demonstrated  by  rigorous  testing.  The  personnel  performing  maintenance  daring 
such  a  test  should  be  service  technicians  of  . average  skill  level  adequately  trained  sa 
if '  system  under  test.  Such  a  procedure  will  assure  that  the  required  aysten  aals- 
tainablltty  can  be  realized  under  more  closely  almutated  field  conditions. 

It  has  been  noted  that  .design  tr.enda  apparent  in  electronic  equipment  aacb  aa 
modular  construction,  printed  circuitry,  eneapaulatlon  and  miniaturization,  point  toward 
a  dIsposat>at*faMure  maintenance  philosophy.  Such  a  ptiilosuphy,  if  ecromtecily 
]ustUiab*,«,  would  result  in  a  reduction  of  high<skill  training  requirements  aiica  a  leaaer 
technlclal  competence  could  achieve  quality  corrective  maintenance  in  the  field.  Mess 
net  time  to  repair  failures  would  be  decreased  and  the  possibility  of  retaining  a  given 
reltablllty  level  tnrough  the  life  of  a  system  would  be  improved.  ...  -  -  . 


In  recent  years  a  continued  advance  ot  technological  atandarda  has  taken  0acc, 
and  in  the  future  greater  nuinbei'u  of  scientists, .engineers  and  technicians  will  be 
required  to  support  and  iurther  this  advancement.  The  military  departments  asust  also 
(are  a.-i  ever*tncreaslng  need  for  skilled  manp'Owcr  as  a  result  of  the  increasing 
comple.xlty  of  weapons  systems  brought  into  operational  use.  If  this  need  is  lobe 
satisfied,  interest  in  the  sciences  must  be  stimulated  in  students  at  the  earliest  possible 
age. 

•  To  alleviate  the  problem  of  the  present  shortage  of  skilled  technicians  l«  rtte 
services  before  it  roaches  damaging  proportions,  steps  mu.st  be  taken  to  enhance  tbt 
military  career  and  reduce  dependence  on  civilian  contract  personnel  in  vital  aasign* 
menu.  If  men  could  be  persuaded  to  remain  in  the  service  for  long.r  periods,  the 
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resultant  dollar  savings  in  training  could  tn  expended  in  Improving  pay  scales,  housing  . 
facilities,  fringe  benefits  and  so  on.  *rl>e  existing  high  turn*over  rate  of  trsin^  men  • 
represents  a  very  lartis  annual  dollar  wastage. 

The  pieSeui  extensive  training  of  technicians  is  resulting  in  very  inefficient 
utitizalton  of  manpower.  To  improve  this  situalion,  the  limit  of  c.nc'thi.'^  of  the  tots) 
remaining  enlistment  could  be  adopted  as  a  desirable  maximum  time  tor  training.  • 

Basic  tralnl.ng  for  technicians  should  be  limited  to  elemenury  electronic  concepts 
wltn  minimal  mathematical  content  followed  hy  the  appucation'of  fundaioentsts  to 
specific  systems  emphasising  te.-.<lt  anaij-sts,  repair  methods,  and  practical  use  of  test 
equipment.  Naturally,  such  training  programs  must  depend  upon  the  basic  poticiet  and 
procedures  demanded  by  the  equipment  involved.  Advanced  or  college  training  should 
be  reserved  for  those  men  with  longer  service  commitments.' 

To  organlte  a  successful  training  program,  it  is  essential  that  production 
equipment  be  available  for  training  at  the  earliest  possible  time.  In  addition,  information 
on  fundamental  changes  in  a  system  not  included  in  original  training  courses  must  be 
made  available  through  technical  publications  or  field  training  courses. 

Every  effort  must  be  made  to  maintain  a  high  degree  of  inierest  In  trainees  and 
technicians.  Consequently,  aehnicat  information  should  be  providnd  in  simplified  form 
with  adequate  explanations  and  perhaps  illustrated  by  cartoons  avoiding  the  vernacular 
and  unquantltatlve  phrasirg. 

Investigations  of  equipment  reliability  have  shown  that  great  difficulty  la 
di  ‘.ermining  reliability  in  terms  of  mean  life  has  been  the  lack  of  a  standard  for 
'  )uoc-ng  satisfactory  nerformance.  Without  such  criteria,  the  engineer  cannot  design  for 
a  spei  tied  reiiabi'  ly.  Therefore,  upon  such' criteria  depends  ihc-enttre  reliability 
program. 

To  reatizd  the  inherent  reliability  of  an  equipment  in  the  field,  it  is  essential  .  * 
that  performance  standards  be  established  which  permit  rapid  recogtiiiion  of  unsatis* 
factory  performance. 

Since  equipments  are  expected  to  deteriorate  with  time  and  usage,  it  is 
essential  (hut  a  preventive  maintenance  program  suitable  for  the  equipment  involved  be 
adopted!  However,  p  'eventlve  tnainienaiice  ul  all  components  and  part.i  which  do  not 
ooey  a  wiar-out  law  of  failure  must  be  discontinued.  In  order  for  an  effective 
prevent..''  mainienance  program  to  be  established,  equipment  manuals  should  list 
components  and  parts  which  allow  for  such  maintenance  and  shcald  specify  the  period. 
Unnecessary  liandirng  of  electronic  components  should  be  avoided,  particularly  such 
practices  as  routine  mass  testing  of  electron  tubes.  In  order  for  electronic  components 
and  parts  to  approach  a  wear>out  law,  design  engineers  must  be  educated  in  conservative 
design  and  derating  practices. 

Marginal  chocking  is  consistent  with  preventive  mainte'narice  and  has  been  used 
in  limited  for  ns  quite  successfully  for  some  years,  resntt.ng  in  improved  equipment 
performance  and  a  rcducUcn  in  complex  maintenance  probtems  it  is  presently  being 
e'mployed  in  lai  ge  vacuum  tube  rompuiers  and  c.irly  data  indicates  it  is  essential  as  a 
mair.ter, nr.ee  tool.  It  is  recognized  that  considerable  military  equipment  is  of  an  analogue 
nature,  ai.d  marginal  ctiecklr.g,  tn  the  prese.-it  state  o*  the  art.  Is  r.ot  coiisidered  a 
S'..iiable  mainJcnance  tool  in  this  application.  However,  if  i« 'desirable  that  research  in 
this  areabe  Sir, cel,  unaisiors  are  being  emotoyed  in  ev?r*increaslng  quantities, 

present  investigations  on  marginal  checking  melhoo*  for  this  device  snould  be  complete. 

All  equipment  in  Uie  fieid  requires  adequate  support  in  me  form  of  test 
equipment,  tools,  mainienance  lacilities,  a.nd  spare  p.irl.<i.  Tnese  items  shoiild.be 
aiailat'Ie  'or  maintenance  as  socn  as  new  equipments  are  ,o)aced  in  the  field. 


Performance  of  any  of  the  maintenance  tunctiona  described  above  rnttilnM  itt 
use  of  test  equtt^ment.  Equipment  tunlnR  or  testing  ustns  test  equipment  aeceasitates 
periodic  calibration  of  the  tester.  A  positive  calibraiioa  pfo«[ram  n-ould  be  one  uslac 
standanU  regularly  compared  to  those  available  at  the  National  Bureau  of  Standards. 

It  seems  desirable,  therefore,  to  establish  calibration  centers  based  upon  such 
dependable  sunoards. 


Such  factors  as  air  conditlonlni  of  mainten.'uiee  facilities  contribuld  ai^ntficaatty  | 
to  equipment  reliability  and  fflusl<be  given  adequate  attention  by  both  deaigners  and  ths 
military  departmenta. 


In  the  following  pages,  specific  recommendations  relating  to  various  studies  af 
the  task  gruup  are  included.  Additional  supponlng  details  for  all  topics  can  also  be 
found. 


2.  HECOMMBNDATIONS  TO  TH7  DEPARTMENT  OF  DEFENSE 


2.1  EQUlPME.Vr  MAINTAINABILITY 


All  future  contracts  awarded  by  the  Department  of  Defense  should  include  a 
maintainability  requirement.  Ttie  contractor  should  be  made  to  demonstrate  by 
rigorous  testing  that  his  equipment  has  met  this  requirement  prior  to  quantity  prodoctioa.- 


Maintainablltty  should  be  defined  as  the  reciproeal  of  mean  net  time  to  repair 
failures  with  this  parameter  being  measured  under  condi’.tons  specified  in  tius  rbpbft. 


Service  technicians  of  average  skill  level  should  be  available  to  perform  aisia> 
tenance  during  equipment  evaluation  tests  to  insure  maintainability  based  upon  the 
ability  of  this  average  technician.  -  • 


I*!-' 


For  its  value  to  maintainability  design  and  personnel  planning,  the  approach  for 
determining  the  operation  value  of  an  equipment  given  in  Appendix  A,  p'lragra^  (.9 
should  be  u  d  and  improved.  .  *  ■ 


2.2  AVERAGE  TECHNICIAN 


t  he  Department  of  Defense  should  establish  guide  lines  for  a  study  to  evaluate 
an  ab.4olute  &ver.u!e  iechniclan  o.a  a  common  basis.  A  continuing  review  should  be  made 
so  thai  the  definition  may  progressively  become  more  accurate,  enabling  requirements 
foriechnical  manpower  to  be  more  precisely  evaluated  in  the  future  and  to  enable' 
determination  of  deficiency  areas  in  current  skill  levels.  :  ' 


To  provide' average  'echnicians  for  evaluation  tests  specified  by  OD-3222.t,  tt 
IS  recommended  ihai  the  Oepirtment  of  Defense  use  as  a  standard  for  average  techniefso ' 
the  0  25  to  0.75  limits  as  den\'ed  by  dividir.,  we  graduate's  training  class  position  by 
the  toial  numoer  in  hts  class  Several  classes  must  be  considered  to  secure  the  required 
number  of  teehaici.nns  and  the  group  structure  should  reflect  the  current  military  grade 
dispersal  of  the  services. 


2.3  DESIGN  CO.NCEPTS 


The  Department  of  Defense  should  prepare  Insiruciuns  to  the  military  depart* 
ments  to  jojniiy  establish  economically  justiit.nhle  limits  within  which  modular  units  may 
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bc  disposed  of  rathrr  than  repaired  and  parameters  so  established  soootd  be  released  to 
Industry  for  inclusion  In  design  philosophy. 

3.4  EDUCATION  or  ENGINEERS 


To  alleviate  the  increasing  shortage  of  engineering  personnel,  the  Department 
of  Defense  should  recoumend  to  the  appropriate  Federal  agency  ^^d  to  ;he  Nattonat 
Committee  lur  tiie  ueveiopmant  of  Scientists  and  Engineers  that  emphasis  on  subjects 
such  as  mathematics,  physics  and  chemistry  be  Increased  at  the  secondary  school  level. 
Arrangements  should  be  made  for  an  investigation  into  the  psychological  reasons  which 
are  currently  restxmsible  for  the  antipathy  toward  engineering  sciences  in  the  leen^age 
population,  and  from  this  devise  effective  means  for  countering  antipathy. 


2.5  SHORTAGE  OF  SERVICE  TECHNICIANS 


To  reduce  the  high  turn>ovcr  'rate  of  technicians  ia  the  service. 

•  a.  All  possible  steps  must  be  taken  to  enhance  the  military  career  by  . 
representing  to  Congress  the  adverse  eifects  of  financial  and  fringe  - 
benefit  limitations  on  *he  long-term  efficiency  of  the  services. 

b.  More  effort  and  emphasis  should  be  given  to  utilisation  of  service 
personnel  for  routine  maintenance,  with  correspondingly  diminished 
emphasis  on  contract  technicians  ^or  this  requirement. 

c.  Consideration  must  be  given  to  mobilising  contract  techrical  personnel 
in  their  present  assignment  (until  b  is  implemented)  in  an  appropriate 

'  status  immediately  upon  declaration  of  a  state  of  emergeocy. 


2.1  TRAINING  OF  SERVICE  TECHN1CIA.SS 

The  long  training  time  tor  technicians  is  resulting  in  an  inefftcieot  utilization  of* 
manpower.  If  in  therefore  retunimended  that; 

.  a.  .  The  military  departments  establish  the  three  levels  of  training 
d'  ocribed  in  this  report. 

b.  le  i.iaximum  time  for  training  be  limited  to  approximately  one-third 
o(  the  remaining  enlistment. 

c.  The  Department  of  Defense  conduct  conferences  and  symprisiums 
betaesn  ail  the  military  departments  to  provide  the  stimolaiion  for 
each  department's  introspection  and  re-appraisal  of  tramir^g 
effectiveness. 


2.7  SYSTEM  PERFORMA.NCE  CHECKING  AND  PERFORMa.N'CE  STAf-DARDS 

In  order  for  the  performance  of  a  system  to  be  evaluated  l.n  accordance  with 
established  standards,  it  is  essential  that- 

a.  The  military  deparimcnis  determine  the  mtni.’num  number  of  per- 
form.ince  indices  required  fur  each  class  or  type  of  et,uip.menl  or 
system. 
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b.  Whitrtvtr  feuibtt,  th*  rtqalred  ptrformMe*  tndicM  b*  iaelvM 
tn  the  original  •peetficailon  and  deVgiled  Into  the  equipment  w 
•>eiem  in  the  simptent  manner.  Where  impractical  to  build  la, 
provisions  for  easily  accesalbte  test  ptdnu  shouid  be  brought 
out  {ordinartiy  to  ti>e  front  panel)  In  such  a  way  that  these 
measurements  can  be  easily  and  quickly  made. 

c.  A  performance  standard  be  prepared  for  each  operational 
equipment  or  aysU-m,  and  used  to  determine  that  the  equipment 
or  system  Is  operating  satisfactorily  after  any  mtloienanee 
(aa  defined  in  DOO  Directive  3232.1). 

d.  Operators  and  technicians  be  trained  to  recognize  and  use  the 
information  derived  from  performance  indlcee. 


2.8  PREVEIH'IVE  MAlNTENANCf 

To  lake  full  advantage  of  the  beneflta  of  preyenttve  malnfenance,  it  ie 
recommended  that: 

a.  Preventive  maintenance  be  limited  to  componontd  and  part* 
which  obey  a  wearout  taw  of  failure. 

b.  The  MIL-SPEC  on  equipment  manuals  be  supplemented  by  the 
requirement  that  such  manuals  give  complete  listing  of  parUi 
and  components  obeying  a  wearout  law  Specifying  the  period  . 
for  their  preventive  maintenance  as  well  as  the  procedure. 

c.  The  definition  of  preventive  maintenance  given  in  paragraph  4.3 
of  this  report  be  substituted  for  that  given  In  DOD  3232.1. 


2  0  MARGINAL  CHECKING  ... 

Marginal  checking  Is  an  effective  maintenance  tool  in  Its  proper  applications 
and  would  reduce  operational  failures;  Therefore,  it  is  recommended  that: 

a.  Consideration  be  given  tb  the  potential  benefits  versus  the  ' 
additional  cost  for  marginal  cheeking  in  ail  vacuum  tubs 

■  digital  equipment. 

b.  The  manufacturer  be  required  to  furnish  initial  prescribed 
marirlns  and  the  testing  frequency  for  all  effected  sections 
o(  a  oystem  or  equipment. 

c.  Present  investigation.^  of  the  application  of  marginal  checking 
in  transistorized  equipment  be  continued, 

d.  Research  In  the  field  of  marginal  checking  applied  to  analog 
devices  be  extended. 


l.to  SQUIPMENT  CALIBRATION 

To  usure  uniform  and  «d«<)uat«  calibration  of  teat  M|ulp<nent  tbrougbout  all 
military  Inatailatlona  It  la  recommenord  that: 

a.  Calibration  center*  be  eatabliahed  at  varloua  locations  to 
supplement  exiating  facilittes  and  employing  standards 
regularly  compared  against  those  available  at  the  National' 

Bureau  ot  Standards.  (MBS) 

b.  Handbooks  be  provided  which  include  comptets  calibration 

information  baaed  upon  NfiS  standards.  ^ 

c.  Mil  Spec  inchtrte  a  re<tulrement  for  specifying  test  equipment 
accuracy  and  precision  in  two  ways;  standard  deviation  and 
maximum,  deviation. 


a.ll  SUPPORT  MATERIALS  •  ■ 

Since  any  maintenance  program  is'so  dependent  upon  the  availability  of 
adequate  support  material,  tt  is  recommended  that: 

a.  Department  of  Defense  expand  the  maintainability  section  of 
DOD  Directive  3222.1  to  require  concurrent  purchase  of  all 
supporting  faciiittes  for  new  production  equipments. 

b.  Each  set  ot  technical  maintenance  publications  be  supplemented 
with  one  or  more  handbootes,  written  informally,  well  illustrated, ' 
In  simplified  form  and  covering  broad  principles  of  function, 
maintenance  and  operational  use. 


3.  SUPPORTING  DETAtl5  FOR  EACH  REPORT  SECTION 


5.1  EQUIPMENT  MAlNTAtNABIUTY 

DISCUSSION  .  ■  .  •  . 

3.1.1  DEFDnKC  MAINTAWABIUTY 

Brfore  progress  toward  better  maintainability  can  be  expected,  the  formulation 
cil  a  rigorous  deliniuon  is  essemtaL  One  reference  (24)»  uses  this  definition: 

"Maintainability  is  a  function  of  the  rapidity  and  ease  with  which 
mainlenance  operations  can  be  performed  to  help  prevent  mal¬ 
functions  or  correct  them  if  they  occur," 

WTilIe  this  provides  notions  of  what  the  concept  may  be,  It  docs  not  provide  a 
ur.'vocal  basis  of  agrceme.it  and  seems  to  entail  con.siderafions  of  both  corrective  and 
preventive  maintenance.  The  definition  is  lacking  in  that  it  does  not  give  the  operations 
which  specify  the  concept  maintainability.  (J6) 

•  Numbe.'S  in  parentheses  refer  to  '.tie  bibliography  In  Section  5. 
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‘To  ovcrecmo  thttoitiotion  It  to  propootd  thtt  molnUlmbllHy  (M)  bo  tefIM* 
la  terras  of  a  meuurablt  quantit;>*»asaa  net  time  to  repair  Isilnrsa  fx^  If  tbt 
iDdirictua!  net  tines  to  repair  failures  are  a^,  Xj,  X||,  then 

a 

(1)  ■  X-  r  x/a 

Maintainability,  M,  is  then  defiaed  by 

(2)  M-l/x, 

usini  the  reciprocal  form  to  mabe  maintainability  increase  as  mean  act  tine  to  repair 
failure  decreases. 

3.1.2  MEASURING  h(EAN-NET-TtME  TO  REPAIR  FAIUIRES 
To  measure  x,  the  loUOridnp  conditions  are  required: 

(a)  The  measurement  of  each  x^  should  be  made  with  the  system 

or  equipment  in  an  oi.erational  environment  or  one  closely 
approximating  that  imndition.  '  •- 

'  (b)  Net  time  to  repair  should  include  all  time  lost  i2»  to  failnrsa. 

'  in  any  part  cf  the  system  Including  tims  tost  duo  to  deficient  ' 
manuals.  Time  lost  In  making  repairs  due  to  lack  of  parta« 
unavailability,  of  power,  or  any  other  factora  which  are  not 
within  the  control  cf  the  designers  of  the  systtm  should  net  * 
be  charged  to  net  time  to  repair  a  failure.  Koweve.*,  a  record 
of  ail  such  times  and  their  causes  would  provs  valuable  for 
eliminating  future  bottlenecks.. 

(c)  Service  personnel  of  sverage  Skill  should  perform  the 
maintenance  rather  than  engineers  or  contractor 
representatives.  The  subject  of  average  tebhnlclaa  is 
treated  more  fully  in  the  .next  section. 

(d)  The  maintenance  personnel  employed  should  be  given 
adequate  schooling  in  the  system  prior  to  the  test. 

(e)  Any  special  test  equipment  needed  for  the  maintenance  of 
the  system  should  bt  provided  together  with  the  normal 
test  equipment  found  in  the  environment  In  which  ths . 
system  is  expected  to  be  located. 

3.1.3  CONITOENCE  LIMITS 

For  assurance  that  the  test  re.iuUs  are  meaningful,  the  confide, ice  limit  of  the 
parameter  being  measured  should  be  ccicuUted.  (Note  1) 


To  ariive  tt  tte  coqflilenc*  limtt  for  x,  it  la  ntctaaary  to  atao  ttettraJna  »,  tte 
■Uiulxrd  devixtiun  of  %  du7is(  the  aalniaiMbtlity  teat,  where; . 


where  n  ia  the  number  of  failures  repaired. 

From'  X  and  a,  the  confidence  limiu  of  the  parameter  being  measured  can  be 
determined. 

Confidence  limits  are  distributed  sensitive;' thercfore  the  probabihtp  dislrlbu- 
iidn  of  the  mean  should  be  determined,  where  feasible,  lor  each  maintalnabiUtjr  trail. 
(Note  2) 

The  case  of  the  normal  distribution  may  be  •ised  as  an  illustration  of  confidence 
limit  computation.  This  method  is  very  oftem  used  when  the  data  are  too  scant  to  allow 
determination  of  the  distribution  involved.  (Note  3)  ' 


-given  by: 


The  confidence  limits,  1^,  (y),  for  the  mean  cf  s  normal  distribution  are 

(4) 

where  Lj  is  the  lower  limit,  tj,  is  the  upper  limit,  i  is  , 

defined  by  equation  (1),  s  is  defined  by  equation  (3),  and 
t  Is  the  critical  value,  of  t  for  n»l  degrees  at 

fre'edom  at  y  probability  level.  This  functio.n  is  extensively  ■ 
tabulated  (.Vote  4);  however,  table  1  is  included  as  a.».  aid 
to  clarify  t.he  computation  and  a  completed  example  can 
be  Icund  in  the  Appendix  A.  Section  6.1. 


T4SIE  1.  CRITICAL  VALUES  OF  STUDENTS  t 


Degrees  of  Failures  (n) 
Freedom 


1 

2 

3 

4 

5 

6 

7 

8 
9 

19 

Infinity 


2 

3 

4 

5 

6 

7 

8 
9 

10 

20 

Infinity 


Probability  Levels,  (y): 


6.16. 8J  9 
31.598 
12.924 
8.610 
6.869 
5.959 
S.408 
5.041 
4.781 
.\883 
3.291 


.  Jr  i » 


The  table  shows  that  the  critical  values  ot  t  decrewes  ver>-  slowly  lor  n^JO. 

This  oilers  reasonable  hope  that  signilirant  data  can  be  .obtained  in  tests  ol  moderate 
Janicth.  It  should  be  pented  oat  however,  that  s  increases  with  n,  although  it  tends  to  do 
so  verv  *lowlv.  This  increase  can  be  quit?  rapid  il  relatively  lew  extreme  values  occur, 
for  this  r.  a.sor.,  nuy  be  advisabh-to  adopt  a  method  lor  rejecti.oit  of  outlying  observa¬ 
tions.  .  (t.'n  * 

Since  ihe  Task  Group  having  cofrniaance  ci  reliability  meas.irement  is  using  the 
9CtT  {77l  level  of  probability,  and  this  practice  should  be  lollowed  in  this  instance.  In  any 
event,  confidence  limits  must  be  given  or  the  tests  will  oe  much  less  adequate. 

The  conlidence  limits  should  prove  ol  considerable  value  it  ola.nning.  olllcers 
and  operatn  .na!  commanders,  but  -J,  in. addition,  t!ie  probability  distribution  ol  mean  net 
time  to  repair  failures  is  determined,  maintainability  .can  be  stated  as  a  probability- 
that  a  repair  ol  the  system  will  take  given  time.  This  would  then  be  analogous  to  the  usbal 
deliwtion  ol  reliabdiiy:  i.e.,  ilie  probabtlitv.ol  no  failure.  in  T  hours  is  given  by. 

(5)  P^,  -  e.'i  (-Tm), 

where  m  is  the  arithmetic  mean  of  the  times  between 
failures.  (26)  Thi.  is  the  desirable,  type  of  definition; 
and  can  be  obtained  if  it  is  found  that  the  distribution  nf 
mean  net  times  to  repair  failures  is  as  conslstant  as  is 
the  distribution  of  the  failures  themselves.  (12) 

Notes  .  ■ 

1.  The  confidence  limits  of  a  parametert  e.g.  u,  the 
population  mean,  are  those  limits  which,  for 

.  '  random  samples  from  the  population  in  question, 

.l.ave  a  probability  of  y/lOO  that  u  is  included 
wilhin  them.  Where  0  -  y/ljOO  -1,  the  limits 
are  called  the  y%  confidence  limils.  See  c.g.. 
references  (3),  (10).  (18)  for  the.general  theory.  - 

2.  For  tests  for  probability  distribution,  see  ref¬ 
erences  (13)  and  (15).  U,  e.g.,  a  Poisson  dls- 
•tribution  is  feund  for  x,  reference  (5)  can  be 
employed  to  compute  the  coriirience  limits. 

For  iion-paranietric  confidence  limits,  bee  ref-. 

-erence.s  (11)  and  (17).'  Obviously,  every  effort 
should  be  made  to  avoid  u.se  of  these  limits. 

3.  The  method  is  based  on  the  cUlssIc.  paper  of 

W.  S.  Cosset,  wno  used  the  pseudonym  "Studest” 
whence  comes  the  name  "S*edent”  t,  reterence 
16).  • 

4:  See  references  (1),  (2),  (4),  (8),  (91  and  (14). 

u.l  4  OBTAINT.SG  MAl.VTAIKABUy  EQUIPME.NT 

A  gre,it  i-ler*!  of  sound  werk  Ins  been  done  to  enable  engineers  to  design  easily 
m.iii.tanj.iile  ^•le(•lro^,;(•  sydems,  n-t  they  mu.st  be  odur.yted  in  tlie  subject  and  compelled 
s!u.:y  ii.  .is.^imi’a!''  if,  .ini!  )nctir{K>r'>te  it  in  the  systems  which  they  are  presently 
d,  S!,;:..';c.  Tht-  s  jrt'.t  n  iy  I.:  -'lo  this  is  to  incnide  an  ironclad  maintainability  requtre- 
m'T.*  -11  the  spf  fiJ!C.«'ii  IIS  for  each  new  system,  giving  malr.tainrbillty  an  operational 
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definition  ri  the  type  >et  out  »bove  ini  nforottsly  testing  and  enforeinit  It.  t  this  is  don^, 
the  design  engineer,  will  provide  the  ir.a:nti*nib:lity  the  servtees  so  desperately  need. 


3.1. S  RECOMMENDED  DESIQS  REFERENCES 


Some  of  the  letter  works  on  designing  maintainable  equipment  ai*  references 
19  to  38  and  62.  Further  references  aiay  tv  f^nind  :n  the  lollow'ing  bibliographies;  for  the 
older  literature,  Gen  CasiorpwsW's  6.i«2  item  bibliography  gives  fairly  good  coverage, 
though  much  of  the  material  in  his  bock,  refererce  {251.  is  not  germane  to  our  topic;  for 
the  more  recent  tiicrature,  see  refererces  (27),  (30),  (31),  (35).  (76),  (78).  and  particularly 
reference  (20),  which  is  »  serial  publiraiion.  Aniong  the  design  manuals  themselves, 
references  (24),  (3&),  and  (62)  are  particularly  recommended. 


COKCUISIONS: 


ft  la  concluded  that  the  principal  ceea  in  the  field  of  maintalnabiHty  is  m  oper> 
ational  definition  oi  maintainability  which  should  be  included  in  all  future  contracts  for 
equipment  or  systems. 


3.2  AVERAGE  TECUKtCIAM 


DBCUSStON: 


In  tne  maintainability  section  of  this  report,  one  of  the  required  conditions  Stated 
for  measurlrg  mean- net -time  to  failure  daring  system  eyaluatioo  tests  was  th.*  use  of 
f.verage-shlU  service  technicians  for  all  aainterjnce  functions. 


This  w-as  stated  becaust  a  ir.roatena.'ce  capability  is  dependent  to  a  large  extent 
upon  the  technician  available  to  tnaintair.  tr.e  required  equipment.  Actually,  the  “average” 
Mchnlcian'is  the  key  to  the  mainienance  problem.  He  must  be  coMidered  when  training 
programs  are  eitabl'ished,  when  test  eqj.pr.'.er.t  is  designed,  when  accessibility  of  com¬ 
ponents  IS  coas.dvrrd  and  when  publications  are  'i-ritter..  With  a  standard  for  "aifrafe”- 
technician  available,  it  should  be  possible. to  re-eirph.i.nize  to  drsignersthe  need  to'  '  • 
consider  the  capability  of  this  tcchnicia^..  particularly  with  regard  to  the  provision  of 
adequate  and  accessible  test  points  w-ithir.  systems,  ease  of  adjustments,  accessibility,  etc. 


CONCLUSIONS: 


A  standard  for  "average"  technicia-n  is  essential  so  that  a  system 
m3ir.taiii,’.biiity  can  be  designed  wit.*:  this  tvchaioiari  in  mind.  A 
group  of  "average"  technicians  for  the  purpose  of  cbeckirg  the 
equipment  niaiiitainahiiiiy  ccu.c  be  ct-;a:i:,v.  by  dniding  i.he  grad¬ 
uate's  class  pr.silion  by  the  iota;  r.-n.txr  of  .^tudent.s  i*”  ftis  class 
and  'as‘"g  the  limit.s  0.25  to  0.75  as  ctfi.ung  the  "average".  • 


The  evaluation  of  the  ".itxoiuie  averace"  leclT.iCMn  sho-  M  alno 
tie  bales  upon  IQ,  an  electro.nc  a.otitu::-'  test,  high  .<ch;v-l  grades 
compii’tod,  college  ve.irs  e..Tip;f  iru  s?r.-;a!  .sc'^'ice  school.' 
and  years  of  service  mair.tci  ar.ce  evp:r.er''e.  ’ 


See.  Appendix  B. 
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M  TRADONO 
DeCUSSIOK:  ■ 

5.3.1  GENERAL 

Befor*  a  aucceMft:!  nutinUnaitc*  program  can  b«  rcallMd,  maintenance 
ffluat  be  given  adequate  tralcing  on  tbelr  equipment  or  fyatem.  Many  factora  cootnbittiaE 
to  •tKceaalul  training  nurt  be  reviewed.  Thia  study  resolved  itacU  into  sia  major  ares^ 
each  atfecting  Uie  maidteoance  traioing.  These  arse 

1.  Education  d  Engineers 

'  -  2.  Shortage  at  Senice.  Technldans 

S.  Ttramiog  at  Service  Technictans 

4.  Manuals  and  Publications 

5.  Support  Material 

6.  I>lsposable>at4aiIurs  Maintenance. 

3.3.2  EDUCATION  OF  ENGINEERS 

The  denelency  at  skiUed  engineers  and  technicians  is  not  peculiar  to  the  scr« 
vices,  but  is  a  national  problem.  MS.  47}  A  continuing  deftcic.icy  eil!  adversely  suect 
the  nation's  economic  and  induitnai  erowth.'ane  in  !;3ye  repcrcusstoos  oa 

litttnsf  Dote.dlail.  {nil  la  the  teng  run,  this  Shortage  can  only  be  remedied  by  tocreaslag 
the  output  ot  euitably  trained  stude.its  Irom  schools  and  colleges.  In  n  democrstic  asUoit. 
this  must  be  achieved  by  stimutating  interest  in  engineering  at  the  earliest  possible  agSk 
.A  commendable  start  in  this  direction  has  been  msdc  at  Bay  City,  Michigan.  {Mj 

-  Enrollmenl  in  tnaibematics,  physics  and  chemistry  have  declined,*  partly  due  to 
the  shortage  at  suitably  qualUied  teachers,  and  partly  due  to  the  cost  at  providtng  and 
supporting  adequate  laboratory  facilities.  Industry  realised  the  necessity  of  iesatieg 
adequate  numbers  of  technicians  in  future  years,  and  has  made  offers  to  aid  by  aeaas  of 
part 'Itme  teachers  and  fl^ciaisoppoit.  (49) 

CONCLUSION: 

It  may  be  concluded  that  our  technlloglcal  standards  viU  contlnus  to  advance,' 
and  that  in  future  even  greater  numU'rs  of  scientists,  engineers  and  techoidans  iriU  be 
required  to  support  and  further  this  tdvanrement.  (47)  Stmllr'ly,  the  services  »nU  bs  ■ 
faced  with  a  need  for  skiUed  men,  increasing  in  proportion  to  the  compleaily  of  tbs 
weapons  systems  brought  into  operaMonal  use  by  the  need  to  uphold  peace  from  s  pbsitMS 
of  strength. 

3.3.3  SHORTAGE  OF  SERVICE  TECHNICIANI 
DBCUSSION; 

The  general  shortage  cf  skilled  personnel  previously  discussed  Is  enhanced  for 
the  services  by  the  relative  aCiractivenese  of  employment  In  Industry,  with  its  present 
high  iv<ge  levels  and  the  introduction  of  ever<inrreasing  fringe  beucflis.  (32)  nervtce  Ufe 
•.mpQSSS  many  restrictions  on  "be  technicitui  by  requiring  the  performance  of  noc-teeb- 
nical  routine  duties,  such  as  K.  P.,  guard  duty,  etc.  hi  adoiticn,  bousing  in  many  areas 
presents  a  problem  to  the  irarried  ca.’i. 


*  Appendix  A  Section  9.2. 
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BecaitM  at  the  ■hort*it»  ct  eldlM  techntckt  ptreoaMl,  mr.lBereMiiif  VM  W 
beiftf  stMe  e(  contract  acrvicea.  (53)  For  eaka  ot  dtacuf iton,  the  categoriee.  o(  aervlce* 
ofacai&e<i  (rom  a  contractor  will  be  overeimplllled  Into  techoicaLand  non-techolcaL  An 
exaspie  at  the  former  la  the  matatensnee  at  eiectronic  sjroteme;  the  Utter,  preparation 
and  of  foixi.  The  groop  feels  that  the  irorc  complex  the  task  and  the  more 

oie  function  performed  >s  to  the  completion  of  combat  activities,  the  more 
necessary  tt  iS  for  the  military  to  have  control  of  the  personnel  executing  the  taaks. 
Acccrd-.-.«:y.  the  trend  to  contract  catering  is  condoned,  while  contract  maintenance, . 
With  r.5  present  tunitatiun  amplitied  below,  is  condemned. 


Actually  the  increased  use  at  contract  services  sggravates  the  original  shortage, 
since  this  creates  more  opportunities  for  civilian  employment  for  the  service  technician, 
«ho  cis  leave  the  service  and  return  to  carry  out  ihe  same  duties  as  a  civilian,  not 
Subject  to  military  discipline,  free  at  domestic>type  chores,  on  a  higher  pay  scale,  and 
with  mare  more  privileges  tnan  before.  Actually,  In  one  service,  more  than  one>haU  of 
Its  mamtenance  is  accomplished  by  contract  personnel.  (54,  p.l48)  This  process  is 
diljiir,;;  the  operational  capability  and  effectiveness  of  the  armed  services, .and  will  restrict 
mobiiitv  f.  time  ol  emergency.'  Additionally,  contract  perttsmel  tend  to  fill  states-slde 
pc±:&,'  lea  ,- ng  the  less  desirable  areas  to  be  manned  by  military  personnel  and  so  further 
dscrcasiac  morale.  •  . 


The  existing  high  turn-over  rate  of  trained  men  represents.a  very  large  annual 
liolUr  t^astzge.  If.  men  can  be  persuaded  to  remain  in  service  for  longer  periods,  the 
resuitam  dollar  saving  in  training  may  be  expended  in  improving  pay  scales,  housing  ... ' 
facilities,  fringe  benefits',  etc.'  For  example,  considering  a  man  who  it  to  carry  out 
eif  ht  rears  cf  service,  two  years  of  which  will  effectively  be  training.  To  provide  men  * 
on  four  .  ear  term.s  to  cover  the  same  period  in  the  field  reqolres  three  men  to  be  trained 
in  succession.  'ITiis  is  illustrated  in  the  figure  1  below:  ' 


0  .  •  2 
{  'Training 


On-the-job 


8  Years 
2 


\  Training 

On-the-lob 

Training 

On-ttie-Job 

Training 

On-the-job| 

Figure  1.  Training  Comparison— —Long  term  vs,  short  term.enlistmeots 


The  saving  vf  training  expenditure  on  two  of  these  men  would  in  nself  enable 
increased  to  be  given  to  the  lo.ig  term  man,  and  further  economies  would  be  effected 
by  virtue  U  t.ie  reduction  of  personnel  required  to  provide  supporting  services.  There 
are  als.-  i-ti-igibie  but  si^.n-Jicint  gains  to  be  expected  in  the  form  of  increased  skill  and 
efficie.-ic>  fr-erc  the  long  term  mar.  as  be  gains  experience. 


Tc?  faiiacy  in  the  use  cf  Ihe  contract  services  is  that  there  arc  no  existing 
d;rect;v-s  ;■  .-r.niiidiiitcl.v  .niobiiiae  conirartor  personnel  In  their  present  jobs  upon 
decla /  xn  emergency,  tr.  .addition,  some  contractor  personnel,  presently  per¬ 
forming  .•ti.'.u  e-ssential  to  the  services,  have  a  reserve  s(.atus  and  a  mobilization 
ussigi-n-f-.:  t'.>!  woiiid  pull  them  sway  from  ;h.’»r  present  position.  Tha  relocation  of 
pcrsc.^re i  ir  -  sre  presently  perform, .ng  esseiitisl  functions  at  the  mOMCnt  of  emergency 
IS  vie-r.-}  w.'ti  trtpidatioa. 


CONCUSIO.V: 


A  »ery  rra!  problem  c.xisis  in  this  area,  althou/;h  It  is  difficult  to  distinguish 
tietwec.'  :j-.  i;  i-.d  effect.  I'r-wv.er.  it  is  necessary  to  at'emjX  some  .'ihcviation  of  the 
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probleiB  betore  it  reaches  damattine  ptofontotm.  Operaiioui  capaUliijr  is  likely  to  be 
impaired  by  the  exressfvc  use  of  coniraci  persotinei  unless  they  are  retained  in  lime  of 
national  emerj«ncy  The  task  troup  has  no  kotiwled^e  i-f  such  directives. 

3.3.'4  TRAININC  OF  SERVICE  TECHNICMNS 
OBCUSSIOiV- 

The  maintenance  requirements  of  the  three  service:,  due  to  differing  equip* 
ments  and  operational  applications,  coupled  i^tth  the  broad  but  unique  geographical  en* 
vti  unmenls,  tnukc  a  general  assessment  of  training  metti'^s  dtll.cull. 

t’ader'the  present  mamienarre  concept,  and  until  a  better  rdurational  system 
pruridt :  men  Mith  improved  background,  it  ts  unlikely  that  the  demand  for  technically 
qualified  mainterjincc  personnel  at  urgan.zati'mal  and  fteid  ievcis  cap  be  met  in  the  near 
future.  In  addition,  changing  techniques  .nete&sitate  a  continue:  examination  Of  training 
and  manpouer  requirements.  ^  . 

'Aben  reliability  is  increased,  it  uill  reduce  the  number  of  maintenance  opera'- 
tions  to  be  carritd  cut  in  a  given  period,  thus  easing  tne  b-rrten  or.  the  skilled  technician. 

It  IS  likely  that  trends  to  miniaturization.  e.'i'-apsulatiOA,  rr.od,.iar  construction  and  the 
use  of  printed  circuits  will  lead  to  tavo  ma:n  changes  ta  maintenance  operatSens  at  user 
ariivities.  First,  where  econumicallv  fcasiole.,  a  dtsposal-at .failure  maintenance  con¬ 
cept  may  develop.  Tnfs  will  further  relieve  m.iir.ienaace  operations  at  user -levels. 
Second,  vtiere  repair  is  }ustJiable  on  eccnotr.-.c  grounds,  it  is  jikely  that  higher  echelon 
Riaiiiteitanie  u-ill  be  necessary,  using  dip-soiaer  ternniq-jes.  re-pot::ag  and  re-sealing 
of  -units  and  modules.  If  so.  this  wilt  again  ease  mainterance  requirements  at  field  levels, 
although  adding  f-rther  problems  in  oth.-f  -reas  such  as  sparfs  s-up^rl. 

The  Icr.E  training  timts  for  technicians  ;s  res-ulting  ir  a  very  inefficient  . 
utiiizatic of  ,iianpov,cr.  A  longer  time  in  tn-s  f;eid  for  a  less  Sroadly  trained  man 
seems  to  offer  greater  total  returns  to'the  sen-ices  for  t-ieir  manpower  input.  ’Hel- 

cretice  (4-5!  IS  q-Joted  in  part:  "Hence  the  drattee  graduates  . . . U-ere 

funclio.ii.iu  as  satisfactory  repairnter.  for  ai<sit  s.»ven  moitns  ih  Uu-  field  before  being 
discharged  "  ‘  .  ■ 

In  -ivvi  of  the  above,  it  seems'  appropriate  to  re-orier.t  the  training  to  provide  ' 
Inreo  depths  vf  training:  basic,  advanced,  ar.c  tvliege.  While  :t  is  recognized  that  any_ 

•  ruining  progra.i.  mast  depend  upoi;  the  bus-.c  ina.iitenar.'-e  policies  and  procedures  de- 
lernnned  lor  tht  cquipmem  involved,  it  is  felt  that  basic  training  would  consist  of:  •, 

a.  HuSic  and  eUmentarv  •'lc-etr..inic  concepts,  iwlitieni  for  an 

u:  -i>-retam5mg  of  further  tra.r.aig.  'oat  havsne  a  mihima*  mathe- 
m.iti-.-a!  c'-ntvnt.  ,  .  -  • ' 

b.  Apf'licatinn  of  the  fendam-rtais  of  efe.-trcnics  to  specified 
systems  and  equipments,  wr..-.  tne  ceuiect.  U  :ecn»tig  fault . 

•  analysis. 

c.  The  prmciples  and  prac'ical  use  of  test  equipment  •itilized  for 
fauit  ar.aiVM.s  on  sys'etr.s, 

d.  Repair  methods,  mrludmg  sp-i.al  handling  t-chniques.  and  denil- 
.  oi-.sir.-)ling  giKid  maintenaace  me? -tods  and  practices. 

Ti.o  at!va->ced  tr^iiniig  Houlii  be  lot  me.  v--itti  at  ie’ist  two  ycais  .service  and 
-.i.->r.!ri  -.i,cJi.it  r:.,rc  math  .-ind  theor>  The  ooii-g*.  tra."''g  -o-.’-i  oe  fu.'  men  with  four 
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years  service  and  «ou!d  encompass  rourses  to  '{tialify  as  a  maintettance  encinesr.  Tht  • 
Task  Group  felt  tliai, approximately  one<tk(rd  d  the  total  ramaiiilBc  eniistmeitf  a 
desirable  maximum  time  for  training. 

To. insure  the  success  of  the  training  program.  It  is  axiomatic  lhat  training 
activities  should  receive  production  equipments  at  the  earliest  f/ossibte  time..  To  divert 
equipment  intended  for  training  purposes  into  operational  use  is  false  economy  in  that 
systems  cannot  be  operationally  effective  u-ithout  adequate  maintenance  support. 

A  tong  period  frequently  elapses  between  design,  prototype  manufacture,  and 
production  for  field  use.  Some  technicians  will  have  passed  through  training  schools  at 
too  early  a  stage  In  receive  training  on  liew  equipment,  but  will  meet  it  in  the  field.  Hence 
designers  and  manufacturers  must  feed  irdormation  to  training  activities  whenever  npw  . 
techniques  wilt  cause  new  maintenance  procedures  to  be  adopted,  in  order  that  the  trainee 
■  mav  ha.-e  some  foreknowledge  of  the  characteristics  of  the  system.  This  should  not  be 
den'e  at  too  early  a  stage,  for  obvious  reaso.*is. 

CONCLUSION: 

The  service  training  programs  can  be  made  more  efficient  by  review  of  ^ir 
requirements  and  means  of  attaining  them. 

3.4  rC«rORMA.NCE  CHECKING  AND  PERFCHhfANCE  STANDAHD 
DISCUSSION: 

To  recognize  the  need  for  immiyiiate  maimenance  of  equipment  and  to  be  cerlaiq 
an  equipment  is  in  satisfactory  condition  after  either  corrective  or  preventive  maintenance', 
it  is  essential  that  stamiar.-tc  {«.  judgment  be  provided  (S3>.  (S6),  (57). 

Periodic  performance  testing  against  known  :.tandards  will  indicate  degradation  * 
ar.d  uasaiisfueiory  performance  with  relative  certainty.  Such  testing  is  disHnct  from 
preventive  matnicnance  and  differs  from  marginal  checking  since  if  is  not  intended  to 
delect  or  aggravate  a  jxitrnlia]  failure,  ft  is  intended' to  provide  l^h  operators  aid 
mj*nit.*iiancv  personnel  with  approved  .ind  accurate  medns  of  recognizing  an  unsai isfaciory 
situation. 

ncliablllty  as  wel!  as  maintainability  should  auiomat'.caliy  improve  by  providing 
3  pi’siiivv  indication  that  an  equipment  performance  exceeds  minimum  staniards. 

CONCLUSION: 


It  IS  concluded,  therefore,  that: 

1.  Equipments  or  systvnis  shoul  be  designed  to  provide  evidence 
of  .sjii.sf.i'.iory  performance  in  as  simple  a  manner  as  possible 
Hence. 

2.  Performance  standards  are  required  in  order  to  determine  when 
equipments  or  systems  are  opt*rat:np  satisfactanly  either  before 
or  after  any  m.i4i:ien.ir.ce  (as  defined  in  DOD  Directive  3232.1) 
has  been  performed 

3.  in  addition,  prartieal  performance  stand.vrd.s  can  be  used  advan- 

ill  the  tramir..:  cl  both  operators  am’  niainlena.'ice 
I--er.so.nneL  Kewever, 
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CofWiitPiit  ptrformtiic*  ind.*  «r*  rcquirtd  ■«>  UuU  tht  mrvieet 
havt  •  C'lremon  denominator  of  performance  etaadaidi. 


3.S  PRCVCNTIVE  MAIN'rENANCC 
DISCUSSION: 

P>"t  experience  has  shown  that  rreventive  maintenance  in  its  proper  application 
is  a  Valuable  method  of  linprovinf  an  equipment's  performance.  However,  this  U  oaljr 
valid  when  applied  io  components  and  parts  which  obey  a  wcarout  law  at  failure,  such  ac 
mechanical  parta  and  rotating  electrical  machinery.  Thut,  lubrication,  clcaniag,  brush 
cncculng,  etc.  should  be  continued. 

Preventive  maintenance  is  an  invalid  procedure  for  all  entities  for  which  sa 
expeneniial  failure  law  prevaiht  (26,  30).  This  presently  includes  electron  tubes, 
resislors,  capacitors,  nduetors,  transformers,  and  most  elestronle  parts  (40).  It  fails  for 
this  category  because  'heir  failures  cannot  be  localised  in  time  in  order  to  present  a 
uniquely  advantageous  period  lor  maintenance. 

Preventive  maintenance  of  eiectronte  cbmponenta  and  psrtt  ahould  bs  avoided 
because'  it  caunes  man  malfunctions.  Tubes  are  replaced  in  the' wrong  sockets,  connect*  •' 
ors  and  cables  are  damaged,  circuits  are  detuned,  servoa  are  unbalanced,  thus  emergency 
mainterance  Is  after  mecessary  as  soon  as  equipment  has  undergone  preventive  main* 
tenance.  Routine  mass  testing  of  eiectron  tubes  is  pariiculatly  undesirable.  . 

Marginal  checking  (41)  is  consistent  with  preventive  maintenance  since  it  does 
allow  the  failures  to  be  localised  tn  time,  and  in  the  technique  may  lie  at  least  part  of 
the  answer  to  the  preventive  maintcrance  premiere.  However,  failure  prediction  (42)  is 
.not  consistent  with  preve.itive  maintenance  because  it  is  a  sequerdlal  technique  and  thua 
does,  not  provide  the  indispensable  localisation  tn  time. 

CONCLUSION: 

1.  It  iG  concluded  that  three  processes  offer  some  hope  at  sllowfng  the  *  . .  . 

application  of  preventive  maintenance,  in  its  traditional  sense,  to  ■ 
elecirunic  equipment.  These  are; 

a.  Education  of  design  engineers  in  conser'/ative  design  and 

derating  pra-itices.  Where  this  has  been  done,  the  wear-  '  .  ■ 

out  iew  has  been  lapprouched  by  etectrenie  components  and 

parts  (43).  The  most  immediate  promise  is  offeree  by  this 
process. 

b.  Perts  can  be  improved  so  that  they  obey  a  long-term  wear- 
out  law  when  properly  applied.  This  process  depends  on  (a) 
above. 

c.  Marginal  checking  techniquei  can  be  applied  to  petmtt  local¬ 
isation  of  failures  In  time.  Tnese  techoiq’jes  require  some 
development,  paitlcuiarly  m  regards  their  application  to 
analog  device. 

Other  ce.-.clusJo»ii»  are: 

2.  Preventive  nuliitenance  should  be  limited  to  components  and  pe.rts  which 
obey  a  wearout  law.  As  yet,  this  does  not  inclidc  electr'clc  components. 
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>.  l^ertcUrc  l&URttaanc*  of  t<«ctroaie  eoraponcftt*  aad  rootlM  hm* 
tsfltlni  o(  •IcctrtM  tubet  ahoaki  b*  afotded. 

4.  Marflwl  cbacklnf  ta  a  viild  fora  of  praventire  autatafitiiea  fa«t  failura 
prfdtctton  la  aoL 


3.6  MARCmALCKECKmO 


9.6.1  OENeRAt. 

To  aocorapllab  th«  detection  of  pctentla)  sTateu  taHurea  by  marttnat  cbacaii.d> 
it  ta  necesaary  to  alter  the  normal  operating  condltiona  of  the  ayatea  ao  aa  to  cauae 
faiiurea  whenever  components,  whuih  have  objectionably  deteriorated,  are  preacnt.  (60) 
Syatem  performance  can  be  greatly  improved  by  detection  and  removal  of  thoae  com* 
ponanta  which  could  cause  operational  failurea  before  the  next  maintenance  period.- 

The  more  common  meana  of  marginal  checking  ia  to  vtJry  a  ailected  aervlea' 
voltago  supplied  to  aystem  circuita.  (60)  However,  it  is  conceivable  that  marginal  checking 
could  be  cccomptiahed  by  variation  of  other  circuit  or  ayatem  phrnmetera.  Tba  meana 
aelected  ahould  provoke  failures  which  cam  be  rapidly  iaoiated  for  correctloo. 

3.6.3  HARCINALCllECiaKG  DIGITAL  DEVICES 

Systems,  such  as  dlgl'sl  computers,  with  a  go>no>fo  characterlatic  in  tbatr  . 
baate  circuits  lend  themselves  well  to  marginal  checking.  (61) 

In  targe  digtul  computers  which  involve  thousands  «f  miiltiplc  use  vacmim  tuba  . 
circuits,  marginal  checking  ta  camidered  an  essential  feature  for  effecUra  maintenance, 

(60)  Here,  circuita  performing  similar  or  related  functions  art  grouped  and  marginal 
checked  together.  This  grouping  ia  carefully  done  ao  that  marginal  failures  can  Uolated 
Even  so,  many  groups  may  exist  in  large  systems;  hence,  It  ia  necessary  to  employ  into* 
matic  marginal  checking  through  computer  programming  to  test  the  entire  system  in  a 
reasonable  length  of  time. 

3.6.3  IfARGINAL  CHECKSfQ  ANALOG  DEVICES 

In  gcne.rsl,  analog  computers  have  continuous  rather  than  go-no^go  character* 
Istlcs.  Electro-mechanical  and  electro.’ilc  analog  computers  normally  use  closed  loop  . 
circuitry  with  negative  feed  back  to  stabilize  the  circuita  against  Internal  component 
deterlnratlon  and  external  disturbing  factors.  Marginal  checking,  as  described  above, 
applied  to  an  analog  dmee  would  result  In  a  gradual  detericration  of  performance,  such  ' 
as  reduced  syeteoj  velocity  eonstanl  or  overshoot,  etc.  rather  than  Indiscrete  failures’ 
which  would  cause  mai.denance  personnel  to  suspect  their  epu'pment  wdt.bout  providing 
ample  isolation  of  potential  failures.  In  addition,  setting  the  rejection  levels  for  com¬ 
ponents  '.i.uld  be  difficult  therefore  a  means  for  marginal  cnecldng  ot’oer  than  the 
simple  varying  cl  semce  voltages  would  be  required. 

3.6.4  LIhnTATIO.NS  OF  MAKGINAL  CHECKING 

Marginal  checking  apparatus  usually  represents  a  significant  part  d  the 
equipment  cost.  Therefore,  the  inclusion  of  this  c.ipabiiity  in  a  h.phly  rebable  system 
would  be  dilflcvlt  to  justify,  However,  the  benefits  in  ellnilnating  potential  fail’urcs  and 
ix-.'tating  intc.-niitfor.t  la.l'.s  wouid  normally  always  be  realized  to  some  jlegree.  This 
would  even  be  true  for  sniill  sysiems  alib-o’agh  here  faults  can  usually  be  .•■eaJily  isolated 
by  other  techniques, 
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For  rach  ayatm,  a  be  neceatary  to  tiraluate  the  need  for  m  mariSna) 
checking  rnpamlity,  recognizint;  tu  beneliu  and  ccmparing  thi<  lt»cMt  and  the* 

.  fuitablliiy  (d  other  techniques. 

From  information  received,  a  successful  method  of  ma.ginai  checking  transistor 
circuits  has  not  bec.i  found.  It  is  known  that  transistors  fail  more  by^deterioration 
rather  than  catastrcphicaily  and  their  reliability  is  high.  Unless  resolved,  the  tack  of 
marginal  checking  may  present  maintenance  problems  in  systems  using  transistors 
extensively. 

While  a  manufacturer  should  recommend  the  prescribed  margin  to  uae  and  the 
testing  frequency,  it  will  be  ’.ecessary  for  the  using  organization  to  alter  them  as  experi¬ 
ence  dictates  (62).  .< 

However,  this  would  require  the  using  organization  to  maintain  sufficient 
performance  records  for  their  own  analysis  before  approving  changes.  Accurate  details  - 
lor  such  a  record  may  be  difficult  to  acquire  in  view  of  past  history  in  this  area.  ■ 

'  J.8.5  E,NVIRONM£NT 

It  was  generally  felt  that  marghial  checking  would  have  practical  value  for  fixed 
or  shipboard  digitit  systems  provided  space  were  available. 

Consideration  of  weight  and  size  in  airborne  digital  systems  otter*  problems 
which  might  prohibit  its  inclusion.  This  equipment  is  relatively  new  and  It  in  understood 
marginal  checking  for  such  systems  is  under  study.  Its  application  in  modified  forme 
should  be  possible.  ..  .  ' 

CONCLUSIONS: 

1.  It  was  generally  agreed  that  marginal  checking  la  a  valuable 
maintenance  toql  (63)..  Ta  particular,  its  most  valuable  applleatloa  *  . 
if  In  vacuum  tube  digital  systems  aiid  here’ ths  benefits  aa  dt- 

.  scribed  by  the  de'initiona  would  certainly  be  experienced. 

2.  A  marginal  checking  capability  may  require  considerable 
additional  costly  equipment.  Therefore,  it  is  felt  that  maigluat 
Checking  has  questionable  justification  U  the  Inherent  reliability 
of  a  system  is  high  or  if  the  system,  being  small,  lends  Itsstf 
well  to  other  maintenance  techniques. 

3.  In  view  of  ihe  present  state  of  the  art,  characteristics  at  analog 
systems  are  such  that  marginal  cheeking  is  not  considered 
feasible.  Houever,  it  is  considered  de.sirabie  that  research  la 
this  field  be  extended. 


3.7  EQUIPMENT  CALIBRATION 
DISCUSSION: 


Maintenance  of  electronic  equipment  requires  the  use  of  precision  test  equip*  ’ 
fsent  for  a  varieiy  of  measurements.  These  include  frequency,  power,  and  sensitivity, 
along  with  manv  oihcr-s,  each  being  measured  tc  oplimizc  equipment  performance  or 
Ciagno-se  trouble,  Ui  many  Instances  an  equipment  is  te.sted  at  more  Iran  one  facility  nr 
circumstam-cs  .-cqjirc  that  or  more  equipments  calibrated  f.l  different  locations 
I'pcrme  ■viifi.ii  (heir  .speci/iod  range.s  for  compatibility.  This  r:;qulrement  Impedes  a  need 
for  uniform  I'llibration  standards  throughout  a!)  military  Installations. 

tail 
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Since  the  National  Bureaa  <<  StaAdarde  (NBS)  coOd  provide  (siSionp  ftaadardi, 
it  would  be  highly  desirable  to  develop  a  cahbration  program  employing  suadardi  eet£l» 
natmg  at  NBS. 

Calibration  renters  located  :n  selected  areas  dependent  upon  NBS  torehecaa  oa 
standards  could  be  established  to  tmpiesten!  the  calibration  prosram.  Such  cemcra 
adequately  sta/ied  and  properly  equipped  could  supplement  existing  facilities,  par&calarly 
overseas.  Itiey  rould  be  available  to  more  tlon  one  service  if  this  resuha  te  ecoeemy 
without  loss  in  efficiency. 

To  implement  such  a  program,  it  would  be  necessary  for  DOD  to  eaiabilsb  a 
coordinating  group  tor  monitoring  purposes  who  could  ascert^n  the  number  c(  measare- 
ments  to  be  made  on  specUied  parameters,  aral  develop  a  calibration  program  toacrag 
that  all  field  calibration  activities  have  proper  capability  to  maintain  high  staadards  eg 
accuracy  and  precision.  Once  the  program  is  developed,  the  assistance  reqatied  fm 
NBS  should  be  specified. 

Information  required  to  perform  complete  calibration  of  'equipment  aamdd  be 
included  in  handboclcs  and  based  upon  common  definitione  ci  stmidards  used  by  N3S. 

MIL  Specs  should  require  that  test  equipment  accuracy  aiid  precision  be  stst^ia  two  ; 
ways:  Standard  deviation  and  Maximum  deviation  over  one  year  measured  by  adiectlflc 
methods. 

Overall  calibration  checks  on  equl.  only  in  narrow  rangM  are  act 

necessary,  yet  account  shou'd  be  taken  cf  new  equipment  expectecL 

A  report  to  be  published  by  C.  a  Moore  of  Naval  Aviation  Eleetroalca  Semce 
Unit  and  Task  Group  fl  considers  the  ge.neral  problem  of  whit  accuracy  cf  a*tadsr«ls  it 
required  to  Insure  a  given  accuracy  at  calibration  centers.  It  solves  the  main  pr.iblem 
by  mathematical  theory  Of  probability  and  treats  the  limitations  of  measurement  freai. 
both  a  physical  and  psychological  view  point.  It  justifies  the  use  of  standard  deviation 
and  a  acientlfic  determination  of  maaiaiwa  deviation  in  specifications  and  gives  a  method 
for  reducing  errors.  In  addition,  consideration  la  given  to  the  ccmpour.dt.'ig  of  errora 
thiough  R  chain  of  calibratlona. 

Most  of  the  jjertlnent  information  on  the  subject  la  included  in  an  indexed 
blWiograpny  of  more  than  COO  items  on  electrical  measurement,  metrology,  theory  or  . 
errors,  and  human  factors  in  measurement.  -  ■ 

CONCLUSION; 

1.  Present  l  allbtatlon  facilities  should  be  suppleniented  by  calibratloa 
centers  with  standards  regularly  compared  against  those  available 
at  the  National  Bureau  of  Stsndards. 

2.  Common  definitions  of  standards  should  be  employed  in  Handbooks 
nff«p|nj  rnmnioi*  ralibratlon  informition. 

3.  Mil  vSp'-cs  should  include  a  require.T.cnt  fer  specifying  lest  equlpr  M 
accuracy  and  precision  in  Hie  tw;  ways  specified  above. 
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S.t  SUPPORT  MATClUAL 

PBCUSSlOW 

3.5.1  GENERAL 

Field  BuintenAnce  retiree  Uut  aU  o<  the  (oUowiBc  matertAl  eoadltiOM  be 
provided  concurrecttjr  vith  a  aystem  for  an  etlecuve  procrAim 

A.  Test  ettuipment  and  tools  (both  standard  and  speeial) 

b.  Test  faciliUea 

c.  Spare  parts 

d.  Adc<tuate  pu'sUcatlons 

«.  Provision  for  tralninc  m^rW 

Sens  e,  d  and  c  apply  to  Items  a  and  b  m  well  as  the  aqatpnieat  soppoited.  - 

New  eiittipmeitts  are  placed  In  the  field  before  adequate  support  for  then  has 
been  provided.  This  results  in  extra  efforts  to  make  field  ImproeiaatiOBs  which  would 
not  be  neceseary  If  adequate  support  were  provided  in  advance.  Thia  pra^feo  alao 
reaulta  in  degraaation  of  operational  effectiveness. 

A  variety  of  factors  contribute  to  this  situation:  operational  denaads:  proeort' 
ment  laws;  service  organization  for  developinent,  procurement,  maintenasce,  etc.  As  ■ 
example  of  the  flagrant  disregard  of  past  experience  is  the  fact  that  spare  psM  prpcuco* 
ment  negotiations  had  not  been  initiated  on  the  scheduled  delivery  date  for  a  large  radar. 

3.8.2  MANUALS  AND  PUBLICATIONS 

Many  excellent  suggestions  for  improved  maintenance  handbooks  and  tschnlesl ' 
manuals  are  avalhible  (24),  (26),  (58).'  However,  maintenance  handbooks  and  tschnicsl  * 
manuals  as  required  for  higher  level  fflair.teiu.nce,  naturally  contain  highly  technical  data 
and  complex  circuit  diagrams,  which  provide  the  soimce  of  reference  data  for  the  ex* 
perienced  syst«as  analyst  and  repairman  technician.  ■  This  content  ami  format  does  not', 
provide  'he  right  approach  nor  level  of  delmeacton  and  readability  to  vbe  traliice.  The  - 
trainee,  by  and  large,  has  considerable  dJficulty  in  arowUiw  oeif-«rter«t  csd  nrn>trt 
mn.-cais  an- C'jfiaiRjy  ;«i;  a-  i  r.iivsa.:^«racurrl«ul»r  study.  The  tlow  analyst  Is 
forced  to  wade  through  a  manual  m-jcn  more  canplex  tlian  necessary  lo  extract  the  mora 
primary  level  of  implementation  lequired  of  his  station  of  training. 

In  many  cases,  mui'iais  give  iriormatior.  In  qualitative  form  when  quantitative 
form  would  be  very  desirable.  Expressions  such  as  "current  readings  may  be  above 
normal  during  run-up  pericxis"  are  meant.'igless.  This  points  to  a  requirement  for  one 
or  more  supplemeniary  publica’idns,  written  down  in  technical  level  and  In  less  formal 
style,  to  familiarize  trainee  and  inexperienced  personnel  with  xny  given  system.' 

It  is  recognized  that  all  military  depertmenta  and  services  do  not  have  exactly- 
the  same  problem  in  detail:  nevertheless,  the  problem  is  the  »ame  in  principle,  ft  may 
well  oe  that; 

a.  For  army  tactical  gro>eid  repai.*  support  troops,  as 
manv  os  three  aduuional  supplementary  handbooks 
are  dvisible  because  o!  the  more  definitive  five 
echeton  ulructure  or  steps  of  maintenance. 

b.  For  .-.a-,  .1  nl.ipboard  or  air  force  imnlrmentation, 
oriy  one  s'jppiemer.tiry  lu.idx'ok  may  be  desirable 

.  .  due  to  tiv:-  trend  toward  combining  «k*  fsrst  sOur' 
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■tep«  of  maintcn«iKC  abotrtt  •Uav  ater*  statkw'or 
airfield  reapecuvetjr. 

For  army  fixed  atatio,  equiptnent  e:;p;crt.  it  is  alw 
likely  that  one  supplementary  book  aocid  scffice. 
since  the  shipboard  or  airfield  s!tua::c«  cf  conbtnlnf 
the  first  three  and  scmettmes  four  steps  of  maiste* 
nance  are  combined  at  the  Site. 


CONCU:siO.»S; 

1.  New  eqaipments  are  being  procured  without  ade^cate  support.  TMs 
practice  results  in  inefficiencies  and  loss  of  openttooal  effMlveaesa. 

2.  Ln  order  to  awaken  and  maintain  interest  in  trainees,  inexperienced 
technicians  with  a  need  to  know  infortaauor.  for  lower  level  maintenaece, 
it  Is  desirable  to  publish  one  or  more  succfemesra rr,  t»^rrs:a!ij>  wrlucw 
muuaist  conutning  adequate  explanatory  and  aimpilficd  {hapramt  aad 
perhaf«  illustrated  with  pertlnejit  cartoor.s  to  estpitasiae  Important . 
poinu;  avoid  the  vernacular  aad  unquantltattre  phaa'iof.. 

3.9  SSKlbAL-AT.FAILURE  MAOrrCNANCC 
Dlsr»JSSK)Nt 

•  'The  military  services  are  faced  with  detericrauvg  technli^  skfllt  to  n^ttla 
cqulpme.nt  of  increasing  compleuty.  It  may  be  assumed  that  technically  qualified  per* 
sotuiel  in  numbera  great  enough  to  achieve  quality  mainienasce  in  the  field  wiU  not  be 
available  in  the  foreseeable  future.  The  present  concept  cf  auhitenance  is  based  oo  - 
adequate  technical  ability  at  the  lower  echelons.  Here  :s  a  ccedition  affording  so  escape 
but  that  of  tailoring  equipment  and  uwucepts  to  loser  sid.ls.  R  u  proposed  that  a  0ls> 
potai>at-Faiiure  concept  of  maintenance,  su]:ficrted  by  a  correlated  equipment  desip 
philosophy,  5>?  uuiuiidered  jOtnMy  by  the  millurv  semces,  whiii  wall  achieve  quality 
eerrretire  maintviuuiue  wnen  accomplished  by  the  average  :ech.-iic>a3  Of  tbe  future. 

Desip  trends  apparent  in  the  electronic  field,  such  as.'  modular  consiructioa, 
printed  circuitry,  encapsulation,  miniaturisation,  all  poin:  to  a-n  era  cf  disposal-at* 
failure  maintenance.  It  is  evident  that  the  maintena.ncc  coerept  cf  the  future  must  evolve 
,  to  fit  this  trend.  One  approach,  *hen,  is  to  further  the  abene  trend  arid  desip  mohjlar 
units  which,  cest  heitig  withtn  defined  limits,  may  be  di.epcised  cf  raiher  than  repairecL- 
Therefore,  limit*;  wittiiii  which  it  is  economically  jusid'iabie  to  employ  disposal-a:  - 
failure  malntenrr.ce  should  be  defined. 

The  cost  of  such  a  program  must  be  weighed  agajist  the  benefits.  Ui^tible  and- 
iiilangiole,  which  will  accrue  to  the  services.  This  cer.cspt  should  reduce  the  necessity 
for  training  personnel  to  high  sWJ)  levels  since  a  less*  i  icv-vnicai  co.nipetence  will  achieve 
quality  corr-ctiie  niaiitenance  in  the  f,etd.  This,  howeter,  must  be  reiat.  '  to  the  re¬ 
duced  experie.-.ce  gained  in  fault  anaijsis  brought  abou:  bv  .Tirimiied  repair  at  field 
level. 

Vican  net  time  to  repair  failures  should  decrease  5-.r,ce  wuh  aprropr.stc  lest 
eqiiiymeni  and  lest  points  for  localiaing  faults,  repa'r  wiU  thea  c.-'isis’  cf  replacing  the 
dejeciive  ur.lt  by  a  serviceable  one  thus  rctumirg  the  et-icme*'.  to  v,>erat!‘'  sirens  .n  a 
minlniun:  cf  t;me.  It  may  be  assumed.  h«.wev»r,,  thil  under  ,>?-;ul:ar  ..rcjmsta-hfes  a 
coM.pieve  sys'ec)  may  bo  dispc-fco  cf  more  than  once  6>  I'cremen.is  du.-.iig  its  useful 
life  depi,-nu..'.g  on  the  distnbuilon  of  failures  wi.nin  t.ne  system. 
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Tk«  rr~i8c<l  concejst  will  assist  icreatlv  to  maintain  a  fiven  reltatiiUtsr  Iwel 
U.rooc*'  LV  U.V  at  a  sysletn:  Reduction  <k  excessive  mamienance  prceedarcs.  wtitch  an 
kroar  .;-sa»e  re'ftbJitjr,  and  purpipft  the  logistic  system  of  maintenance  spare 
pars  >■-.  utu-ed  to  iovet  level  specifications  than  tiwse  applied  by  the  system  cos- 
tractor  to  th-  original  reliability  requirement  are  supporting  arguments.  Faults  due 
10  roisnand.  r  during  transportation  will  be  minimised. 

Much  is  to  be  gained  by  the  adoption  of  the  di5pcsa!>at>fsilure'concept  of 
maisterance.  It  must  be  supported  by  a  correlated  design  philost^by  to  allow  the  accrual 
of  qual-tT  maintenance  by  personnel  ol  limited  technical  skill. 

The  release  from  the  necessity  to  provide  highly  skilled  personnel  to.  fltld 
level  macrtenat.ce  will  allow  concentration  of  trained  resources  at  depot  type  facilities 
and  the  number  ct  technical  representatives  necessary  to  support  systcnss  In'the  field 
will  >  resjced  substantially. 

-antithesis  of  the  disposat-at 'failure  philosophy  are  those  of  repair  In  the 
field  or  of  return  to  a  depcf  for  repair.  The  recommended  basis  lot  comparison  ts  cost 
to  repair  vs.  new  equipment  cost.  The  results  in  the  depot  repair  sltuatloo  should  bs 
obtained  more  easily.  The  cost  in  the  depot  sltuan<y*  •“  »t  i!lCsUd«  jMciuiJS,  haodiuigt 
Aikt  itanaponacion  of  the  equipment  from  the  field  to  the  repair  facility  as  well  ss  the 
direct  aad  indirect  expenses  of  the  depot.  U  the  time  to  repair  at  a  depot  Is  appreciably 
diflerers  iron  new  part  procurement  time,  the  two  costs  should  be  adjusted  to  reflect 
this  effect  cc  operating  capabilities. 

In  the  field  mcintenar.ee  situaticm,  the  cost  of  training  and  su(^rting  dlffercef 
numbers  and  quantities  of  men  who  would  be  performing  under  opposing  philosophies 
will  be  d_Tic'Uit  to  assess.  Data  on  this  matter  is  essential  to  valid  conclusions.  CXher  . 
constderiticrui  that  are  ge'mane  to  this  investigation  are  the  effect  of  diaposal*at>fsilur0 
mainte.'a.'i-te  oo  weight,  reliability,  performance,  etc. 

CO.VCU.'rTOXi: 

1.  t!  IS  concluded  tlmt  a  maintenance  concept  which  will  allow  dis> 
pc«al  rather  than  repair  of  modular  units  will  reduce  the  level 
ii  iraiiiii.g  required  by  field  maintenance  personneL .  ft  is  siso 
cor.c'uded  that  the  system  suggested  above  Is  s  feasible.basts 
isT  establishing  a  disposal-at-fallare  design  concept 

;  <.  SUMMARY  OF  OFFINITIONS  FOR  TERMS  lIS’ilD  IN  THB  REPORT 


4.1  MAD»TAINABnJTy 

MamtamabiUty  (MJ  is  defined  as  the  reciprocal  of  mean  net  time  to  repair 
failures  iXi.  Limiting  conditions  are  specified  in  paragraph  3.1. 

5  *re  individual  net  times  to  repair  failure*  are  Xj,  *2"-*n' 
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4.2  SYSTEM  PERFO.«lMA.NCE  TERMS 

1.  Performance  checking  is  a  procedure  to  dctermme  that  operational  per¬ 
formance  meets  orescribed  system  or  cquipm<‘nt  standards. 

2.  Performance  Stundards  are  published  instructions  and  requirements  setting 
forth  the  procedures,  me  Jiods,  and  techniques  for  measuring  the  designed  performance 
of  electronic  equipments  or  systems  in  terms  of  the  minimum  number  of  essentia! 
technical  measurements  required  for  a  specified  operational  capability. 

3.  Performance  indices  are  those  technical  measurements  required  to  Indicate 
that  an  equipment  or  system  mee‘s  its  prescribed  characteristics. 

4.3  PREVENTIVE  MAINTENANCE 

Preventive  Maintenance  is  a  procedure  of  inspecting,  testing,  and  reconditioning 
a  product  at  regular  mtervals  and  accordma  to  spM*ir<c  instructions  in  order  to  prevent  - 
failiiroc  sn  service  -iiu  io  retard  deterioration. 


*.4  MARGINAL  CHECKING  TERMS 

1.  Marginal  checking  is:  (1 )  A  means  of  varying  circuit  or  system  parameters  - 
in  such  a  ivay  as  ‘o  detect  potential  operatio.’ial  failures  in  a  system;  and  (2)  A  means 

of  altering  circuit  cr  system  performance  to  render  intermittent  faults  continuous 
thereby  simplifying  trouWeshooting. 

2.  Prescribed  Margin  (Rejection  Level)  is  the  established  range  to  which  a . 
circuit  or  system  parameter  can  be  varied  without  failure  of  ttie  tested  fimction. 
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t.  APPBNDOCA 


Al  MAISijiS«ABXLmr 

The  fffi;<*srjsg  .-v.. 

affpllcsfiOR  et  th«  fomu!a«. 
<ii»*«a. 


•Se!a4{®ij; 

Q>viotssl)r,  e  «  S 

Trcffl  equatjoa  (I),  t  m  lASj 

ftiuaUfic  (2),  M  *  i  l.  5K,  .  0.51  J 
Froa  equation  (S),  a  >  o.JM  -, 

Therefore  taking  equation  (4)  uitwatepa.'  V.n-U  *  • 

•i.ss-ar5»astfi>/2.2j4  < 

•1.4M 

Cj  •  I.SS  •  a.TT5  *  0.364)  /  2.335  ■ 

•  X4c:2 

that  i.*ie  ae  a  probabUity  of  05% 

the  corre^iu^ values  2.«2  >»««,  aatf  M has  ■ 

reprrse-'t  e*per;^^”  ^  **'  Ulustrathre;  rtey  do  not  pretend  to 
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BtUtcKf  -:  (47),  (44),  (48)  stcuon  5 
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tb.<UUob*^«t,,,o?Lt;Tto^  FtarlSr 

usuuAts  into  pe.  S0M.1  «‘WM«  niqr  b*  combined  to  torniib  mimbern  of 


t5  toto  pe.ao«m,l  RUanm*.  *:  comomed  to  i 


^  c-iffiple«t,  of  Uie  problem,  but  Si*  *>**»<«»  to 

tre  more  clearly  diacemed  OueZ  liire^toS^  r  ‘“*  *?•  *“  *»“«“*  P®*»to 
correlation  of  the  parameters ^  tibrtribctlOM  Md 

of  this  approech.  ^***  **  “  ooseotlal  requirement  (or  practical  list 

OlSOiSSIOK:  .  '  - 

activities  to  ***  arouped  into  two  broad  catacoricf ' 

Uor^i  arc  Sen.ra^rc^red 

I4  me  formula  cfcrcloped,  the  term*  are  deflimd  tt  toltowsi 

R  -  HellablUty  -  mean  lime  tofaliure.  wut,  ..  ^ 

M.huintasnabiutr-.  mean  net  time  to  repair  failure  units  ..  . 

?  -  rrevenuve  Maintenance  »  m.«  net  ujne  to  perform  aU  function,  intended 

top. event  failure,  tuula  —  manbours 
■  -  Pr..«r.  :. 

CjCie  of  prcrenuve  maintenance  units  — 
nqutpmeni  he  urs 

»  -  «ran  net  time  to  verify  th«  a  ayalcm  t,  perfo.^miop  sMtofwrmrUy. 

'  *  SSS  --Utoln*  thal 


*«  fcTiiwlbvii  #  ia«L»,fup  r-^fUtyodfrW^  .  iiAJ~dK_  wTm-^.l'P'irW^W 


4^^  #4.  **»>■»  ,-.*•  *»  in  i 

..  *f  <  .  '  "***•■ 


D  •  Ml;  icary  —  eoiaeaed  mtwur*  o(  na>aMmkdiqr>  mtts  ••  wuMmn/ 


•qup.  bo«irs 


0,.  D,.  Z}j  Mb  «tts  of  D 


A,  B  •  coAStaats 


&  ■>  Z^ttlpBent  Otwratioa  ••  equipment  <>ptti.:itff  t\ar.  omU  ••  t^tilpaMt 
hours  per  i»f  <it>oath.  etc.) 


N  -  Nuaber  ot  cqiupneat  —  number  ol  eqnipsesu  used  bf  s  eommaad. 
units  ••  none 


R  -  Uaa-bours  —  ber  a-.ar.>hours  ue'tle^  to  '^vpott  the  scheduled  ettulpatat 
.jurs.  uoits*«manhours. 


Bp  Rj  •  btdnridual  equipment  mao'hours  required 
0j  -  M  B 
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Tot  the  remnLider  ot  the  development  A  snd  B  •  1 
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Additional  vortatices  on  the  data  are  pcseible.  The  ratio  would  lodicato 

the  relative  eifort  beta-een  preventing  and  repalrtup  taUure«.  A  normalainft  of  D  bf 
dividi.-:;,  hr  ~i  nirber  ot  tuoes.  eum  ot  ail  coui^;  ...li,  or  uc^-vci  iuia  vouid provide 
a  measure  ct  'qcjoisent  relative  to  the  state  ot  the  art.  Is  it  {^imtstie.  to  state  t^ 
trade'OU  ennres  could  be  cstaalished  tor  equipment  acc  .’racy  >s  O,  or  R  vs  D?  tor 
equipment  installed  In  aircratt  it  may  be  dc-slrabtf  to  divide  M  asd  P  into  compoaents 
to  reflect  L^e  time  required  to  get  the  equipment  out  ot  the  place  and  that  required  to 
pertorm  necessary  shop  tiacttuns. 


The  toUowinjg  toraala  can  be  used  to  esUmatt  mai^ower  requirementa  to  support 
s  specific  equipment 
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The  tcihnicii  personnel  requirements  tor  the  aircraft  cocfi^araaon  would  be  the 
siuu  «(  all  tie  indtridual  maapr'er  requirements. 
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D^termlnjUten^ O  nec*«**rjr. 

5  Juiy  iSSa.  accortttnc*  with  the  ij.lent  of  000  Olrecavt  3233.1  o( 

CONCLUSIONS 

^mul*  +  eaeb#  used  to  raeanure  nalnUiflabUitjr  lutd  formula . 

®  total  "r  *“  U»  deteroUatnc  nu-power  re^ulrementa. 
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7.  APPEIfflIX  B 

Oeterm  Utlnf  tht  Arttnf*  Technician 

The  determination  ot  "aormar  or  "averaga’*  performance  of  a  gteen  taak  haa  a  • 
long  Mstor>  In  industry  and  veU>recognized  meinoda  exist  in  the  field.  (64)  (69)  (73). 
While  ail  te.<it  .ng  of  human  ahillties  la  beset  by  ci'rtatn  haaar>ia  (C7),  the  uae  of  test  reeulu 
to  predict  performance  in  a  task  haa  been  found  to  be  satisfartory  (69,  (7t). 

Using  the  ratio  of  class  standing  to  number  in  a  class  as  a  paraasster,  it  is 
possible  to  determine  what  the  range  of-abilities  'bout  the  mean  (0.9)  will  be  tor  various 
groups.  Tie  range  ratio  for  any  percentile  range  can  be  found  from  empirical  data. 

For  the  mean  (M)  and  the  standard  deviation  (S).  the  range  ratio  (U  *  3Sf/(U  «  3S)  is 
found  to  be  equal  to  3.  The  distribution  Is  normal  and  S  •  M/9. 

Therefore,  in  order  to  find  a  particular  range  ratio,  muUiplt  values  of  8  can 
be  mdMtituted  in 

(1)  (Me3S}/(U-38)  *3 

s 

The  multiples  can  be  determined  as  follows;  The  central  area  of  the  normal  enrvs  is  . 
given  tv 


(3) 


s- 


(27n: 
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exp.  (-Vi  tVtl* 
-a 


where  t  >  (X-M)  /8 

’  This  function  is  tabulated  in  reference  791  Sbice  the  answer  ta  in  terns  ci  8, 
the  multiple  values  in  equation  (1). 


Results  for  a  few  values  art:- 

Central  Percent 

'  20 
40 
50 


Range  Ratio 

1.058:1 

1.124:1 

i.XO::! 


Even  for  the  central  SO  percent,  (i.e.,  for  those  with  a  ratio  of  class  standing 
to  number  In  class  of  0.25  tc  0.751,  the  ratio  o(  1  1/8  to  1  between  L*ie  abilities  of  the 
best  end  the  worst  man  in  group  does  not  seem  excessive.  It  would  simplify  the 
problem  of  supplying  tecbnlc-gnj  <or  eviluntlor.  :f  bhe  cfntral  30  percent  were  used,  and 
would  not  Seem  to  exert  an  u.i<iu6  effect  on  the  results  of  the  evaluation. 
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Liberty  5-6700,  Ext,  73091 

Col,  B.  R.  lewrence 

Amn 

Soon  liC-3lt9,  PenUgon 
Waihiiigton  25,  3.  C. 

Liberty  5-670},  ijrt.  763f5 


..,|r--i-^.^bja!«ti>il«l‘'**‘***^*' 


CoDfuItanU 


Pr.  CX*do  Urun  «.tl 
Citner*!  Mills «  Ine. 

2003  1.  Hsiinspia  ivwas 
MlnmapoUe^  Mlaa« 


Mr.  .).  A.  Chsabsrs 
pbosnlx  Resstreh  l*bj«tafi**  ‘ 
'  MotorolSf  Xao. 

?103  S.  lK:l»»ids  »rts» 
Phosnlx^  Ai'itons 


)fr.  <7.  Q.  tsUf 
Ntiiontl  Aca4*Bor  of  Seltneo* 
?;.01  ConstitutioR  Avt* 
Viithlt«toa  2$y  9.  C. 
CCseuUlTO  3>8liOO,  Set. 


Mr.  Richard  Tr  laliMn 
Bell  Telsphoas  Labs. 
Murrajr  Hill,  Mmt  Jarsay 


Obaerrers 

JSXt 


Lt.  Col.  M.  M,  7an  KarXlsew 
Office.,  Chief  BU) 

Offlj^,  C.>lef  of  SUff 
Rooiii  30»1i31»  Pentafoo 
Washlrctcn  25,  D»  C. 

Uberty  S-6700,  Ext.  TTVZ 


Hr.  Saauel  Silxmvma 
Office,  Chief  Signal  Officer 
Rosa  28-262,  Bentafoa 
Waenington  25,  9*  C. 
ilLarty  5-6700,  Ext.  6717? 


Mr.  P.  U  Bedford 
Office,  Chief  Signal  OffUe-s 
Room  28-269,  Pentagoa 
Vaehinglon  25,  9.  C, 

Liberty  5-6700,  Ext.  56P.2i 


M",  j.  voseph  M.  a>n»lneto» 

Office,  Uepaty  Chief  of  Staff,  Logistic# 
loom  19-570,  tbntegoA 
■  hashlngtoa  25,  9.  C.  ' 

-Iberty  5-6700,  Ext.  76695 


Mr.  H.  M.  Nachmia# 

SCEL 

Port  Monmouth,  Kew  Jersey 


Mr.  John  Sehroeter 
Port  Monmouth,  See  Jersey 


Lt.  Col.  R»ul  B,  Sch-Tr^^^* 
Office,  Chief  of  Ordnance 
Root  2E-J82,  Pentagon  . 
Washington  25,  9.  C. 
Uberty  5-6700,  Ext,  7?59i 


.*y.  Biilip  Reiter 
SCEL 

Port  Monmouth,  Hew  Jersey 


hr.  Leo  Schuaantt 
oCLL 

Port  .donnouth^  See  Jersey 


ir=  PCRCT 


Major  Levis  V,  Kleett 
>crPLC,  Hq,  DC 
Mail  to> 

Coarv^ivier,  DC 

Atln»  Major  Levis  W.  Hieatt 

fcrpic 

Wrigbt-Patterson  Air  Peroe  o.i»e, 
lenaore  7H1 


Mr.  Plojd  t.  Matin’ 

LSCfP.,  Kq.  AKDC 

-Hi  11  toi 

Corvjtnder,  A30C 

AtVM  Mr,  Floyd  2.  Veager 

h-rroa 

P.  C,  Sox  1395 
.-.alti.iiore  3,  K-rylaod 


Ittjsr 


Mr.  C, 

Hq,  XX 

Mai"  Vo« 

Co-SMsour,  DC 

Att.'.J  tr.  C.  Llttler 

v.-'-.o  Air  Poree  Eeoe,  CWlo 
Eta.'® re  "1-1. 


^ 


.^  .  -  -  •# 


un 


H».  Stanton  A.  Bennatt 

£ur«ftu  of  r»r<js  &  Books  {Coda  &.23I8} 

Vuhin(^n  i$f  0«  C« 

Uberty  5-^700,  Btt.  75580 


Hr,  3,  M  Brearloy 
Buraaa  of  Atronautlfs 
jiooB  ai99t  Naay 
VAohln^ton  25t  0.  C« 
Liberty  5-6700,  Srt.  6L188 


Nr.  Jess#  L.  Millar 
BiTMtt  of  Ordnanea 
Boon  0U7A,  Main  Kaiy 
Va5hln(ton  25,  B.  0. 
Laerty  5-67CO,  Est.  63993 


Capt.  V.  T,  Casaldy 
Bureau  of  Ships  (Coda  810) 
Boon  3306,  Main  Nary 
Washington  25,  B.  C« 
Liberty  5-6700,  £*t.  61x586 


>«r.  Jferfla  Sshuldanfrat 
Bureau  of  Aaronauties 
Boon  2VLO,  Htin  Mavy 
Vashlncton  25,  B,  C. 
Liberty  5-6700,  Bst.  63203 


Hr,  3,  V,  Greer 
Bissau  of  Ships  (Coda  8l5) 
Roob  33li8,  Klin  Navy 
Washington  25,  9.  C. 
Liberty  5-6700,  Stt.  65933 


It.  Cdr.  Robert  A.  Eldson 
Office,  Deputy  Chief  of  Serai 
Cparitiona  (Air),  OP-555C 
Boos  L!l-l(3tt,  ^ntagoa 
Vaahl*4ton  25,  B.  C. 

Liberty  5-6700,  Btt.  7li75l» 


Capt.  KaroLl  D.  Xaulbaek 

CtW^Code  !i!x35) 

Ross  2209,  Main  Nafy 
Washington  25,  B.  6. 
Liberty  5-6700,  Ext.  61589 


Mr.  J.  B.  Vallaca 
Kaval  Beseareb  laboratory 
Ctda  5ul2 

Vaafclngton  25,  B.  C. 


Nr.  0,  Meuscbaefer 
hWterlal  Laboratory  (Coda  930) 
New  lorlc  HsTal  Shipyard 
Brooklyn,  New  Tork. 


Hr,  Leo  VIUISM 
U.S.  Marina  Corps 
Boon  itl09,  Arlington  Annex 
VaahiiHtton  25,  B.  C. 
Liberty  5-6700,  Eat.  12566 


Other  Government  Agenclea 


Odr,  L.  f.  Frith,  R.K. 

Erltis^  Joint  Services  ttioslon 
IVlO  K  Street,  N.W, 

Washine.ton,  0.  C. 


Col.  H.  V.  Serlg 
Secretary,  AG^T 
31)0  Proalway,  Pth  Floor 
New  Tprk  i?,  ».  T. 


Cdr.  H;.rolH  T,  Ij-.'BrickaC'a 
O.S,  Coast  Guard  Headquartcra 
1300  S  Street,  M.W. 
Wv,hincton  25#  D,  C. 

Oesullve  3-61.00,  B*t.  ?9lfl 


Capt.  K.  t,  Thosts 

Ar.'sed  Services  Electro-Standards  Agency 
Fort  Moavovth,  Sew  Jersey 
Cetontowa  3-1'JOO,  Ext.  22629 


tt-,  Bussell  .StogsaUl 
National  So-varity  Agency 
25,  B.  C. 
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t'Vi'VWV  W-l^  ,  irtWTI 


F.  V.  Morr*!? 

K,,  UC 
Hill  t«i 
CcMadcr^  A* 

Attnt  ar.  p,  V.  K3rr«U 
KJCC 

Vrtsht-P*tt«r*on  /JLr  Pore*  B***,  Qbi* 
Umct*  Till,  Ext,  61203 

H-.  S«»i,;  ??«ftea  • 

of  Co^lcxtiow- 
i**ctroaiea 
UCS/'tJ,  =5.  tBA? 

55-519,  Fentuoa 
25,  0.  C. 

5-6700,  Ext.  53lk36 


Hr.  VlUlaa  *,  Ntill 
«»,  Hq.  iW 
Hill  to» 

CfiwwxJor,  IHJ 

)fc..  wuiu,  H.  KelU 

nujT 

MrtAht-Patt*r»on  Air  ’'ore*  Baa*. 
Kanwra  ?m,  Ptt.  52172  * 

Hr,  TVadarlek  a.  Grtealy 

^»watlona  Amljrit  ^ 

lJUrty  5-6700,  fct,  730IA 


-'^"""^  1-.  -  •■  ^ 


/•”'■''■*  Jf 
1  » 


Tank  (Innip  3 


)1r.  Vi,  T.  lJ*j, •'"ij»;r  i-t» 

;  Mi''<  O'li'D’ir.'i'-l -'< 
l■..i  t/l  ifirMa  -ii.f  }"*» 

^/V 

!f*.  Victor  >!/ifr!ii 
Mr’-  •'■••r  >  ‘f  A.-rri/.a  • 

'/'?  n-’'ptt  ’‘-r/K’t 
■  :  iv-r  •.‘'-'.fjr^a-'yl 

,/'!  :-7:v;  . 


:V’.  kvcr'^'-n 

'■.i-«lrf.,  ""w  li'r-ty 
w  ..him.  ;>t,.  ?»:  57')? 


4-,  n,  ;  irn 

a'.  </ 

.'-•-•icis  {‘r’.f/iiu;  Ur.iiM. 
'*/>  /.Sru 

.V.  i.  '.rlffJtfi 

-  .i'r-  fr-vin^'  C-rvjjid 

ft* 

V-,  A,  v', 

/Vy,  V.'-.',;! 

-I  ^y  *-i 

r  r'--/ 


Ik*.  .‘Ilii.'ir'l  iv.'i'tito Ji 

iV'-CX-'  •»;!;»,  ;  r» 

Aals’-ft  A?*,  a 

r..r*y  ;» a  Cf-rr.r-y 

7.»t’,r.V=vry  3-iXO,  K/t,  5.?54 

■fr,  v.'ililoR  t>.  Wc-ascit 

»*V2  DivisS^/j 

!!'>'y~.  "ufliUorr,  I’Hij. 

To D»  7» 

.yjs«:f*7  'V<.vy,V 


•'r,  :  .  r.lr-r 

♦  ,  '.f*  •  ;  • 

;.'r.  .1  /  .?,  .*I'i  ’..vy 

»»  #  *  •'•  »"y  I  ••  ^  • 

•r,^r*V  f-V/V/, 

''-r-  '*  hyr'irt},* 
i  .r'  :.r  %.'•  t  '*'*/. 

‘$'•9  *1  /  M  y  .Jr 

i  "  '■  -•/'  r,  .t!. 

•  - •'■■ ;  <■  i;.i,  ''*y 


Bi!.yrr..'V.  t'.  Vs.  King 
.  y.  r.  '. ’•.-iy.a 
;  -f'.i .  '  .^^c  Ov,— 5) 


r.A  I.’a’/y 


a:.*;  M!:a, 


•A  ,  K,  J’y  'or 

•<  .^y  /•<: 

*  I 

•  •  •  .^-r,  /«r 
,  .  '  -v . 

1 

W  •».  k.T 

h/t, 


A;f.fir:wt<!  ».o  Mr.  Kox 

•I”.  :!.  .  i.aiirj 

VC.X,  1/.J.  ■AX 
rtiii  tM 
C--**.  yir.  1-* "  I  '^Ar^ 

A’'-.  3-.  <*..  !<V."1ylU»J 

■«".v 

«rU’>’*--r-i',VT'! -ii  Air  ^yirc^  Sas*!,  .hlo 


^  ^  »  _y« _»  fi  ■  r-»' 


V.  H- 


i^g7^;aw3g%<g^iuJ«3WEP^-!t:xg»g!m.gmr^CTgi»gicg^g^a~~*  '^‘'^^MmKJjgjmyjK.'^aiTmaatjaiLMtrai 


Ta>k  Group  4 


H,  C,  H^tiiti,  Chalrssn 
iUdlo  Corporation  of  iMrtea 
Caftien,  Hoy  Jorsey 
Woo^llavn  J-8000,  Bet,  3028 

**“•  <?.  C,  flbClror 
Coliino  Radio  Co, 

C«d*r  Ropldo,  loifli 

Up,  R.  K,  Frotlor 

Sonilx  n>odtieta  Bl», 
Hlah«Mak)i,  Xodtoiw 

C,  D,  Mrriia 

CUSTiUX 

®f  Oonopol  TfyatmieB 
Biaono,  CoUfontU 

iyroaiiig  9-5111 


A,  W,  RoMro 

SCfl, 

Fcpt  Moneieuth,  N.  J, 
Satonuira  3-1000,  Ert,  JiRjt 

•Sr,  V,' Jorgonson 

c'fj,  snrr* 

Soc*  20-369,  PonUgoB 
V»yhir|;ton  35,  0.  C. 
liberty  5-6700,  Ext.  71533 


ft.  3.  H,  Huncy 
National  iureou  of  SUndorda 
^-.^rg.  r,.-c.  Section  {1.6) 
»>«3.-.lr^ton  25,  0.  C. 

CeOe  ii'j.  Ext.  7067 


is.ni 


^**r*.^  wjp.  p*mo« 

•«*.  Royaond  Soward 
CONVAIB 

of  Osnorol  Oycuico 
Poieono,  Cnllfornla 
XCfcoBlng  9-5111,  Ert.  klOf 


i^**V*^  i®  «*>«•*» 

ft.  T.  .1.  JCubllii 
SCO. 

Fort  Horwottth,  K.  Jt. 
fiitontoirn  3-1000 


P 


H477 


>-IR  rORCl 


•Jt,'  £.  J,  Rucel 
Bureau  of  Ships  (Cods  819) 
Rooa  331»7,  Main  Ka»y 
Washington  25,  0,  c. 
liV  rty  5-6700,  Srt.  66ljli2 


ft.  R.  J.  froMW 

vr:i',  prj,  WADS 
jfeil  lol 

C-j-.-jfrier,  Vise 

.’t.  R.  j,  Frsjw 

wr:3 

fS’fl’rraltt,  PJOC 

^^5  '’Clenttric  CoordiMtli^j  Cfflc# 
Hoof,  ?iev  Torif 
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Aitomate  to  Hr,  FrMmme 

•‘t.  C,  R,  Keller 
VC1!>«,  Kq.  WAIC 
K»U  toi 
CoBuswdor,  WADC 
Attnt  Hr.  C.  H.  Ksller 
WCIRE 

Wrlght-htteraon  Air  Fore#  Bnoo,  Ohio 
Kurwiore  7U1  '  • 


»  V»  v'\*^  v-to  L%t.%  t^i  1%  .  % t.'l.'J itn 


tft  ^-K-erk  ^  ^  K  9 


K  «  M  ^  at  •-winaa 


7a«k  Croup  S 


ik*.  l<*on  ?edol<1gr,  C^tirma 
Spragu*  Eleetrle  Ccipux 
.Korth  Ada«Bf 
Jbhwk  3-5»l 

Mr.  Mkresia  Aehesea 

S.ylT«nia  Eleetric  ?ro<^Jet•  Co. ' 

Z«v  aard«M(  L.I..  X.T. 


Ik*.  J.  r*  Srottert 
Ehlloo  Corporation 
C  it  Ontario  Streata 
RillltdeXphiaj  ?a. 

Ik*,  r.  S.  CamaU 
.  Ball  Talapliono  LaPa» 
vnippany,  Naa  itrrtf 


F  *  ■*  » _ I 


m 


,'3V  '  ^  '.  •i 


Hr.  T.  M.  Child 

.  sen. 

Fort  Naaaoutb,  M.  J. 
Zatontown  3*1000 

Hr.  6.  S.  Hc'lma 
RO  DlTlatoA,  OCSigO  . 

Room  26!t8,  Munition*  Bldg. 
Vsahlr^ti^Q  7$,  C.  C. 
U>^r*y  S'S753#  2»t.  e/0ft6 

Hr.  Icitla  Raplin 
XSu 

Fort  Komouth,  R.  J. 
tatont'-rt  ■*■.■*  rw 


Altamate  to  Mr. 

Ik*.  J,  W.  Gruol 
Si.fcl 

Fort  Mbnnouth^  M.  J. 
SstontowB  3*1000 

Mr.  ilo*  Kaufkaa 
OCO.  OOTB-AS 
■  Wool*  2C-ltC,  Fantagon 
VMhiAtUV  i$,  0.  C. 
liberty  $-6700,  ftt*..  75150 


I -'4  'w'-e*'  .#  -S'' 


I  ■-  >  >  .1./' 

t.  '*.n  '.‘xw 


Ik*.  I.  C.  "a-  ilM 
Riireau  of  onip?  iCoda  ®16) 
Room  33k?,  Main  Karr 
Wanhington  ?5,  0.  C. 
liberty  5-6700,  Sxt  2X 


Mi‘.  „.  A.  Krof 
-'jrrau  ci’  $hipr  (Cfle  517) 
Boon  335*>,  Miir  Sayy 
Wa*Mnpton  ?5,'  0.  C. 
llt-rty  5-6700,  Ett.  6U335 


Mr.  F,  T.  Wengar 
Rons,  Hq.  ARDC 
Mill  toi 
vo.-nancter,  ARjC 
Attnj  It.  F.  1. 
R!>T!3R 

F.  C.  Bex  1395 
BalilMart  Mt. 

M*.  tkYid  Sail  no* 
BCCTX,  Cocf.  *  . 

Eii^-'r.  lib.  1 
Uoaw.  V>w  Tor. 


*.  S*ry.c»j< 


iltrrn»r,e  to  Sr  »< 
V.  V.;.  S.  >i» 

VTRSJ,  Hq.  WJOC 
n.\i  tci 
r  '-r».*v,>r,  VAX 
iVoi  Hr.  Vn.  t,  r«l8 
vr-yii 

•r'.gHt-P»rtepri*v  Air 
^■.jTtrt  '111,  \xt.  r. 


uT  a»  -» 


tOiCkWIV*  J 

lllf 


•  Irf** 


4ik  :*r*«M<*■'»^'ll^■'^>ifi«iyi^'l^itlt<*i  4r‘'^i'fri|^^  ^  ''t1lrt■>-f‘4i^*^^ft'^■^'*“‘^^"' 


Task  Group  6 


*'«  rtt  uicV,  CnslriBSit 
•^•••j*rn  E>rt,ri«*  Co-icny 
Jroadvay 
York  S,  S.  T. 

W-  ’'th  I-Eioo 


’  S»  R,  flurti* 
k  icp  Pr«T:df-nt 
Sir.'  I'jHfg  Cs-inoa  Co. 


M-  A.  fi.le 

■  ■  .*-r..’.’ t/.nni;  Co, 

1-.  N.  iHr**.  t 

rn.t^  If  P,, 


i.  V.iTijir'i  "rvlinr 
JVf  i  ;f ^ 

r  ■ 

t>....  Wf.Tt  :rtr.  Slreet. 
Erlr,  ra. 


Ai-MY 


''•*.  A,  M.  ko-Ve 
FRi 

ASf-rJffn  rVi.a-.r,;  Orouad 
“.»ry:aa.i 


EAVY 


C.  ''•f  - 

r  ils  (c.w 
'■>'  :M’.n  '!^vy 

<  ’t  .ir^toa  ;  ),  Tt.  C. 

5-c..’ 1  ,  .Fjtt,.  u.V-!; 


Hp.  H.  J.  Hnffnsa 
Vies  PwaliJent 

l^ba.,  Inj. 

SUiiford,  Conn. 


W,  A,  tiacDonald 
iUj^ltiae  Electronlrs  Copp, 
y-rS  iittie  !.>ek  Partway 
fjHW  Ycrk* 

"laahirg  IJ-yxi  (S.Y.C.) 


-’laiin  K.  Suru.;.* 
F*t‘C*p*c  Conpany 
t*ort.*4  A<iaiaa|  ^as. 


Altamata  to  Kp.  Hodge 

•'fr.  I.  C,  DrEey 

HIIL 


•’i.-.  i-airey  K.  .lub!  ard 

'-m  jiwi 

r.'.El 

.Mr,  Jot.n  W.  Vr’roeloh 

•“•irt  !.„TsoutJi,  N.  j. 

.t.»  C'll.  J,  t, 

’'/  1  .  '*  ‘  I* ! 

.  •  i*  •  . 

'•  %  w'itV'i**  ?i1g4 

Port  .'fon.'no  itn,  :j.  j, 

►  *  1  t* 

$  *♦  W  * 

-!v  ‘>.(.7  <■..  r*».  ^4550 

•  tj.  C,  I'-ar,nrr*Trii 
CNM 

”  ■>>'-'  ,  .''.iji;  i.avy 

r  c. 

h*t.  o;?;. 


mm  I  I  ;gaQ.qi>t»rrVT'i'T^i  '  \  1  Hi'  'ii'JWi  n  i  m  ^^||| 


4  a  >tyx 


>fc".  Ceorg#  JifiqiuirUi  • 

few*,  Hq.  AHJ  t:'* 

>!ali  tot 
Comm«n^#r,  AW 

jUtni  K  .  Goorge  n«quarUi '  Cer: 

X**'* 

Vi-ight.>?«ttArflon  Air  ?orc«  T>is»,-Chio  WiT 
Seaaore  TUl  -v-,  .. 


Alt«rrk»t«  to  Hr.  Requarth 
Jt".  £.  r.  Tox 
.‘TST,  V  a* 

Jiiil  tot 

Coritnlfr,  AMC 

Attst  Jjr.  R,  B,  Tot  ■ 


fir.  Palmer  E.  Koanlg 
Hq.  ARDC 
Hiil  t«i 
Conaiander,  ARDC 
.1t‘r,i  «r.  ftliirr  E. 
P.  0.  Box  1395 
Daltlaori*  3,  .  1. 


Vr:.,-.:-|%t'crsen  Air  rorcr  K»m,  i:hio 
TUi,  Ext.  7ZLJE/SM6X 

AltrftHta  to  Mr.  Koenlf 
f*".  ?.  ••*.  3uj«r 
v:r,  «q.  wAEc  ■ 

Jlsli  tet 

C'a-aa1»r,  VADC 

4‘tnt  >tr.  E.  J.  r.»0»r  ■ 

VCl  . 

’■*=‘*»-*t'P«t>r»or.  Air  Tcre*  Paw,  CMo 


'wy: 


;rvr 


^'VA<.''<Wrftr ATJtv  rjirnji  ,* j«.n>  'ji  ^  Jf  7  j,  tJi  t  Ji  rjra  iruku  w>  vn  w>  ■->  v%  W'w»a  v.  w  v*»  la.  il-v  *,1  v. 


1 V  TLA  r-\  jLn  i.  nen^  *-. 


ib^  jilwf  Mftiw  H-i  -*  *'-«->'*->  MM  '*  * 


Task  Group  7 


Hr.  lUy  Korrl«,  Ch«irMUt 
R«ob  1536,  T«^>o  r 
SUndinSiutlon  9irl*ion 
atsoiski) 

VtfhingteR  25,  %  C. 

Ubert/  5-6700,  Ext.  655Ut 

H*.  R.  C.  CorderAa 
Vi*«Uni  Electric  Co. 
Vixat«n~$tlM,  North  Carolina 

Hr.  C.  G.  Ciinaia(baa 
S*Ttb-on  Msfrifacturini  Co. 
Valtcaa,  Ttassarnaietta 

Mr.  fl.  S.  !hsm 
Ccllina  Ea;lto  Co. 

(Vdar  Raolda,  Iowa 


kr.  J.  P.  0*Hanlen 

Radio  Corporation  of  AMrlea 

Caadan,  N»w  voriop 

Hr.  V.  H.  H«Einon 
Dept.  1625 
Hu^has  Aircraft  Co, 
tl  Segundo  Plant 
Cttlvar  City,  Calif, 

«r.  P.  C.  Vogt 
Cai«ral  Eloetrie  Co. 
iichanoctidy,  N.  T. 


Mr.  C.  N.  Nickarojn 
Slg^l  Corps  Supply  Agency 
Philadelphia,  Pa. 


Mr.  3.  P.  Schuler  . 
OCO,  C35>‘P 

Rooa  211.316,  Pentagon 

Washin^von  ?5»  P.  C,  ' 


Mr.  N.  A.  -Junker 
Pureau  of  Ordnan:# 
Rooa  ijl'CC,  Main  Nary 
VaeUngton  25,  0.  C. 


Ccl.  P.  1.  Holnea 

>crs,  Kq.  AJC 

?kll  W>i 

Csrsriander,  AJC 

Alt.".!  Col,-  T.  1.  Kul.i«a 

JCTS 


nr.  5,  Schwarts 
Eureau  of  Slips  (Cods  31*9} 
Vashlngton  75,  D.  C.  • 
liberty  5-6700,  Ext.’  63309 


A3t  rOBf.g 


Col.  R,  I.  nt-:On 
JCTS,  Hq.  AJC 
Kail  to* 

CciOTsnusr,  AMC 

At'tni  Col.  R.  1,  Jitson 

rE'fE 


Wr'ght-Bitterron  Air  foroa  Ross,  Ohio  Vright-fatterscn  Air  Pores  Base,  Olils 


■wxhijcv  j  >  V  J  v-V."  tr.y^  <t/v< .  jf  *-T 


,  ^  e*f /.v.* .v  if  *  .vxof®®* 


'jfyjwapJi: 


. I  „  ,1 1- 

.jn^p-BKHK-HCM^^  .,.■.■•■ . \<i 


s.j^  ja  V.  im.«tk»»'-*' 


•i#"'****’*’ 


T— k  Group  8 


}%•.  H.  f,  Ul$»r,  CbMlxmn 

SaiyIU  CotTor«tloii 

fUndlA  B«9« 

Albuiiuoniu*,  S»«'  JSsile* 

AlbUf{U<irmi»  ^-lilUli  ftct.  29251 


JKMT 


Mr.  J,  0.  Ourn»y 
OCO,  tnt)?« 

R«o«  2G-317,  PiftUeOtt 
Washin^on  25i  D«  -• 


»>.  VaUac*  I.  Karris 

sen. 

»3rt  Ktrjsoat^i,  Kas  Jarsar 
Katontoim  3-1000,  Ert.  51525 


*.  J.  A.  Marlnancall 
WO  OiTielon,  OCSifO 
Rooa  2609,  MunitleiK  Elic* 

Vaahlnt^ton  25,  0«  C. 
Ubarty  5'6700,  liirt.  47:J9 


KAVT 


Mr,  M.  A.  v'unka** 

Bureau  of  Ot^lnarna 
Reoa  li202,  Main  Katy 
WaaMrujlon  ,5,  D.  C. 
Liberty  5-6700,  Ext.  67009 


Mr.  S.  Schwarts 
Bureau  uf  Ships  .tfaJa  3^'*) 
Roe*  3716,  Main  Maty 
VaeHivsten  ?5,  U.  C. 
Ulerty  5-6700,  Ert. 


Ant  TORCE 


Mr.  B.  C,  Bright 
m.TTM,  Ilq.  AW  . 

Kill  tol 
Cofcnnier,  AW 
Att-ni  Mr.  R.  0.  Bright 
HJSIM 

Vrlyht-Palterron  Air  Bcrc*  ^»e,  Ohio 
leiUMra  7111#  tUt.  6iU30 


Col,  S.  J.  Ortly 
WSTM,  Hq.  AW 

Msil  toi 

CoiStunder,  AW  ■■ 

A'.tiii  Col,  S,  J.  ursiy 
Wt;TM 

W  rtsht-MittBreon  Air  fere#  Ej5#, 
Kerjwrw  7111,  Set,  tii?C 


CMo 


^  .  -v',  rwrjtfJ* '.a.’' 


-  '.r  f  *-  •  -  -c-  e"-  iC  ,r.  .  .  w- 


